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The  second  variation  sufficient  conditions  for  minima  for  optimal  parameter¬ 
ized  control  problems  are  developed.  These  conditions  are  derived  directly 
from  the  second  variation  by  introducing  a  new  variable  fi  whose  differential 
equation  has  the  same  form  as  the  differential  equation  for  A.  The  neighbor¬ 
ing  extremal  trajectories  are  derived  using  the  sweep  method  resulting  in  a 
set  of  Riccati  equations.  In  addition,  the  neighboring  extremal  parameterized 
control  law  is  derived.  This  is  also  done  for  the  case  when  there  are  both 
parameterized  and  nonparameterized  controls. 

A  perfect  differential  is  added  to  the  second  variation  which  reduces 
to  a  form  involving  the  neighboring  extremal  parameterized  control  law.  The 
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second  variation  can  thereby  be  reduced  to  a  perfect  square  involving  the 
neighboring  extremal  parameters.  The  second  variation  sufficient  conditions 
are  formulated  using  these  results. 

Second  variation  conditions  are  developed  for  the  class  of  problems 
in  which  there  are  both  parameterized  and  nonparameterized  controls.  This 
development  closely  follows  the  case  of  strictly  parameterized  control. 

The  second  variation  conditions  are  used  to  solve  a  missile  intercept 
problem  with  a  parameterized  control.  The  model  used  is  an  EMRAAT  (En¬ 
hanced  Medium  Range  Air-to-Air  Technology)  class  of  missile  with  a  single 
thrust  phase.  The  control,  which  is  the  coefficient  of  lift,  is  parameterized 
and  the  control  nodes  are  the  parameters  which  which  maximize  the  terminal 
velocity.  Optimal  trajectories  for  several  realistic  scenarios  are  obtained  us¬ 
ing  a  shooting  method.  The  sufficient  conditions  are  applied  to  these  optimal 
trajectories  and  are  shown  to  be  minimal. 
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Chapter  1 


Introduction 


During  the  past  30  years,  many  contributions  have  been  made  to  the 
theory  of  deterministic  optimal  control  theory.  Much  effort  has  been  devoted 
to  deriving  necessary  conditions  and  sufficient  conditions  for  minima.  The 
sufficient  conditions  are  referred  to  as  the  conjugate  point  or  Jacobi  conditions 
in  the  classical  calculus  of  variations  literature  [1]. 

The  earliest  work  in  deriving  these  conditions  for  optimal  control 
problems  was  done  by  Breakwell  et.  al.  [2].  The  second  variation  was  used  to 
derive  a  neighboring  optimal  control  law  using  both  continuous  and  sampled 
data.  Soon  thereafter,  the  conjugate  point  conditions  were  derived  from  a 
control-theoretic  viewpoint  by  Breakwell  and  Ho  [3].  The  accessory  minimum 
problem  was  formulated  and  issues  such  as  normality  and  controllability  were 
addressed. 

Bryson  and  Ho  [4]  summarized  a  great  deal  of  the  prior  work  in 
the  field.  It  included  the  sufficient  conditions  for  free-final  time  problems. 
However,  these  conditions  could  not  be  applied  to  a  number  of  problems  for 
the  case  where  Q  is  noninvertible  (as  for  the  Zermelo  problem). 

Dyer  and  McReynolds  [5]  summarized  much  of  the  previous  work 
done  in  the  theory  and  computation  of  optimal  control.  They  approached  the 
problems  from  a  dynamic  programming  framework.  They  included  dynamic 
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programming  theory  dealing  with  control  parameters.  Many  algorithms  were 
included  in  this  work. 

Jacobson  and  Mayne  [6]  approached  optimal  control  from  a  differen¬ 
tial  dynamic  programming  viewpoint.  They  described  this  class  of  algorithms 
and  applied  them  to  problems  involving  bang-bang  control  as  well  as  discrete¬ 
time  and  stochastic  systems 

Wood  and  Bryson  [7]  presented  another  set  of  sufficient  conditions  for 
fixed  final  time  problems.  However,  these  conditions  were  rather  cumbersome 
to  apply  to  optimal  trajectory  problems.  While  these  conditions  were  an 
improvement  over  those  presented  in  [4],  they  were  still  difficult  to  apply 
because  they  involved  identifying  a  priori  the  independent  and  dependent 
parts  of  the  constraints  and  they  involved  integrating  two  sets  of  similar  Ricatti 
equations  corresponding  to  the  different  parts  of  the  constraints.  In  addition, 
they  could  not  be  applied  to  the  class  of  problems  where  the  matrix  Q  is 
noninvertible. 

Recently,  Hull  [8]  obtained  a  set  of  sufficient  conditions  for  problems 
with  free-final  time  which  are  easy  to  apply  and  do  not  have  the  drawbacks 
of  Refs.  4  and  7.  A  new  matrix  V  is  defined  whose  inverse  existed  for  the 
case  where  Q  is  noninvertible.  These  conditions  represent  a  substantial  im¬ 
provement  over  those  presented  earlier  and  have  been  applied  and  tested  on 
a  wide  variety  of  problems,  including  a  number  of  ‘degenerate’  non-singular 
deterministic  optimal  control  problems  (such  as  the  Zermelo  problem).  In  ad¬ 
dition,  Hull  [9]  presented  a  discussion  of  the  variational  process  used  in  setting 
up  and  solving  this  class  of  problems. 


A  common  technique  of  solving  optimal  control  problems  is  to  pa¬ 
rameterize  the  control  and  assume  that  the  control  is  piecewise  linear  and 
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continuous  throughout  the  trajectory.  This  is  the  so-called  ‘suboptimal’  con¬ 
trol  technique  of  solving  optimal  control  problems.  If  a  sufficiently  dense  set 
of  nodes  is  chosen  for  the  control,  this  class  of  problems  yields  solutions  quite 
close  to  the  optimal  solution.  The  ‘density’  of  the  control  nodes  depends  on 
the  type  of  problem  and  the  desired  accuracy  of  the  solution.  As  might  be 
expected,  the  more  numerous  the  nodes,  the  more  computation  time  it  takes 
for  a  solution.  The  advantage  of  this  type  of  solution  is  that  the  optimal  con¬ 
trol  problem  is  transformed  into  a  parameter  optimization  problem  involving 
a  performance  index  to  be  minimized  subject  to  a  set  of  equality  and  inequal¬ 
ity  constraints.  A  number  of  nonlinear  programming  algorithms  exist  for  the 
solution  of  this  class  of  problems,  such  as  VF02AD  and  GRG2.  While  it  is 
generally  believed  that  these  algorithms  give  an  optimal  solution,  it  has  been 
difficult  to  show  that  the  solutions  are  indeed  minima  (or  maxima). 

Recently,  Hull  and  Sheen  [10]  have  introduced  a  ‘parameterized  shoot¬ 
ing’  algorithm  which  uses  the  transition  matrix  approach  to  solve  the  ‘sub- 
optimal’  control  class  of  problems.  The  shooting  method  is  notorious  for  its 
sensitivity  to  the  accuracy  of  the  guesses  of  the  initial  Lagrange  multipliers. 
Hull  and  Sheen  have  shown  some  remarkable  results  in  terms  of  the  accuracy 
of  the  Lagrange  multipliers  at  the  initial  time  with  a  relatively  few  number 
of  control  nodes  which  yield  performance  indices  within  a  few  percent  of  the 
optimal  index. 

This  dissertation  extends  the  work  done  in  [10]  by  developing  the 
necessary  conditions  and  sufficient  conditions  for  minima  for  optimal  control 
problems  with  parameterized  control.  In  addition,  conditions  are  developed 
for  the  class  of  problems  where  there  are  both  parameterized  and  nonparame- 
terized  controls.  The  need  for  such  conditions  may  arise  when  solving  certain 
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intercept  problems  in  which  the  missile  is  initially  moving  out  of  the  intercept 
plane  and  a  bank  needs  to  be  commanded  initially  to  get  into  the  intercept 
plane.  Another  use  of  these  conditions  maybe  for  problems  in  which  there 
is  a  switch  time  for  control  discontinuities  or  for  the  case  of  variable  staging 
time  for  certain  rocket  launch  problems.  The  second  variation  conditions  for 
parameterized  control  are  applied  to  a  planar  missile  intercept  problem. 

Chapter  2  contains  the  derivation  of  the  first  variation  necessary 
conditions  for  optimal  control  problems  with  parameters.  A  new  variable,  fi , 
is  introduced,  where  the  derivative  of  fi  has  the  same  form  as  the  derivative 
of  A,  which  is  the  Lagrange  multiplier  associated  with  the  state. 

In  Chapter  3,  the  neighboring  extremal  paths  are  derived  using  the 
sweep  method.  This  results  in  a  set  of  Riccati  equations  which  need  to  be 
integrated  backwards.  This  development  involves  taking  the  variation  of  the 
first  variation  necessary  conditions  derived  in  Chapter  2.  The  neighboring  ex¬ 
tremal  parameterized  ‘control’  law  is  developed  directly  from  this  and  depends 
on  the  Riccati  equations  derived  earlier.  The  neighboring  extremal  paths  and 
parameterized  control  laws  are  developed. 

Chapter  4  contains  the  development  of  the  second  variation,  for  the 
case  of  paramterized  controls,  which  is  obtained  by  taking  the  variation  of  the 
first  variation.  Then,  a  special  perfect  differential  is  added  to  (and  subtracted 
from)  the  second  variation  and  upon  simplification  yields  a  form  whose  in¬ 
tegrand  contains  the  form  of  the  neighboring  extremal  control  developed  in 
Chapter  3.  The  second  variation  also  has  terms  which  are  evaluated  at  the 
initial  time.  The  conjugate  point  conditions  are  formulated  as  a  result  of  this. 

Chapter  5  contains  the  application  of  the  second  variation  conditions 
to  a  missile  intercept  problem.  The  model  used  is  an  EMRAAT  (Enhanced 
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Medium  Range  Air-to- Air  Technology)  class  missile  with  a  single  thrust  phase. 
The  first  variation  conditions  are  used  to  obtain  the  optimal  trajectories  using 
a  shooting  method.  Two  fairly  representative  scenarios  are  presented  along 
with  the  characteristics  of  these  optimal  intercept  trajectories.  The  sufficient 
conditions  obtained  in  Chapter  4  are  applied  to  these  trajectories  and  are 
shown  to  be  minimal. 

In  Chapter  6,  the  first  variation  necessary  conditions  are  obtained  for 
the  class  of  problems  which  have  both  parameterized  and  nonparameterized 
controls.  The  variable  /i  is  defined  in  a  similar  manner  as  it  is  in  Chapter  2. 
The  first  integral  is  also  obtained. 

Chapter  7  contains  the  development  of  neighboring  extremal  paths 
for  the  case  of  parameterized  and  nonparameterized  controls  using  the  sweep 
method.  The  development  closely  follows  that  in  Chapter  3.  The  neighboring 
extremal  parameterized  and  nonparameterized  controls  are  obtained  for  these 
paths  in  terms  of  the  Riccati  equations  which  are  obtained. 

In  Chapter  8,  the  second  variation  sufficient  conditions  for  a  mini¬ 
mum  are  obtained  for  the  class  where  there  are  both  parameterized  and  non¬ 
parameterized  controls.  The  development  of  these  conjugate  point  conditions 
follows  closely  with  that  of  Chapter  4. 

Finally,  Chapter  9  contains  some  conclusions  and  summarizes  the 
important  developments  of  this  research.  Recommendations  for  additional 
follow-up  research  are  also  included. 


Chapter  2 


First  Variation  Necessary  Conditions  for  Problems 
with  Parameterized  Control 

2.1  Introduction 

In  this  chapter  the  first  variation  necessary  conditions  are  derived  for 
optimal  control  problems  with  parameterized  control.  First,  the  first  variation 
necessary  conditions  are  derived.  The  first  integral  is  obtained  directly  from 
these  first  variation  necessary  conditions.  These  conditions  are  used  to  find 
extrema  and  therefore  do  not  indicate  whether  these  solutions  are  minima, 
maxima,  or  saddle  points. 

2.2  The  First  Order  Necessary  Conditions 

An  optimal  control  problem  can  be  stated  as  follows: 


rtf  _ 

minimize  J  =  <j>(xf,tf)  +  /  L(t,x,u)  dt 

Jto 

(2.1) 

subject  to  the  differential  constraints 

x  =  /(f,£,u) 

(2.2) 

and  the  terminal  constraints 

$(*/»*/)  =  o 

(2.3) 

with  the  initial  conditions 

t0  =  to,  =  given 

(2.4) 

xo  —  xo,  =  given. 

(2.5) 
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Any  free  final  time  problem  can  be  transformed  to  a  fixed  final  time 
problem,  including  the  final  time  as  part  of  the  parameter  set,  by  using  the 
transformation 

t  =  {if  —  t0)T  +  t0  (2-6) 

dt  =  (tj  —  to)dT  (2-7) 

where  r  goes  from  0  to  1.  In  addition,  the  control  is  parameterized  over 
Ti  <t  <  r,+1  as 

«  =  «,•  +  (Ui+i  -  Ui )  y  -~~^T)  (2-8) 

(Tt+1  Ti) 

where  rt*  depends  on  the  number  of  control  nodes  chosen. 

When  these  relations  are  used,  Eqs.  (2.1)  and  (2.2)  become 

minimize  J  =  ^(x/,i/)  +  f  (tj  —  to)L(r,x,Ui,tf)  dr  (2*9) 

J  o 

subject  to  the  differential  constraints 

*'  =  (</-  to)f(r,  x,  Ui ,  tf).  (2.10) 

Therefore,  the  optimal  control  problem  is  restated  as  follows: 

minimize  J  =  <j>(xj,p)+  j  L(r,x,p)  dr  (2-11) 

J  0 

subject  to  the  differential  constraints 

x'  =  f(r,x,p)  (2.12) 

and  the  terminal  constraints 

tf}(xj,p)  =  0  (2.13) 

with  the  initial  conditions 


xq  =  x0,  =  given 


(2.14) 


8 


with  p  defined  as 


(2.15) 


where  A:  —  1  is  the  number  of  parameterized  control  nodes.  This  formulation 
of  the  performance  index  will  be  used  henceforth. 

The  constraints  are  adjoined  to  the  performance  index  using  La¬ 
grange  multipliers  and  it  is  expressed  as 

J  =  G(xf,p,  v)  +  J  \H(t,  x,p,  A)  —  ATa/J  dr  (2.16) 

where 


=  4'(xf,p)  +  i/T'Hxt<p) 

=  L(t,x,p)  +  At/(t,i,p). 


(2.17) 

(2.18) 


In  order  to  obtain  the  first  variation  necessary  conditions,  the  vari¬ 
ation  of  Eq.  (2.16)  is  taken,  yielding 

6 J  =  Gxjfixf  “h  GpSp  +  Gu8v  -f  J  [Hx8x 

+HX8\  +  Hp8p  -  8\T x'  -  \T 8x'\  dr.  (2.19) 

After  the  A T8x'  term  is  integrated  by  parts,  the  first  variation  becomes 

8J  =  {GXf  —  Xj)8xf  T  Gp8p  +  Gu8v  T  X^8xq 

+  £  [( Hx  +  A t,)8x  +  Hp8p  +  ( f  -  a;T')a]  dr  (2.20) 

which  is  further  simplified  using  Eqs.  (2.12)  and  (2.13)  (with  8xq  =  0)  to 

8J  =  ( GXf  -  XTf)8xf  +  Gp8P  +  [ 1  \(HX  +  A t,)8x  +  Hp8p]  dr.  (2.21) 

J  0 
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Now,  the  Lagrange  multipliers,  A,  are  chosen  such  that  the  coefficients  of  the 
dependent  variations  (<5:r)  vanish,  that  is 

A'  =  -ifj  (2.22) 

A/  =  (2-23) 

The  first  variation  now  reduces  to 

8 J  =  Gp6p  +  / 1  Hp8p  dr.  (2.24) 

Jo 

Since  p  is  a  constant  set  of  parameters,  the  variations  6p  are  constant,  they 
are  removed  from  the  integral  to  yield 

S3  =  (Gp  +  [ 1  Hp  dr )Sp.  (2.25) 

Jo 

The  first  variation  must  vanish  because  Sp  can  be  either  positive  or  negative. 
Therefore,  the  coefficient  of  Sp  must  vanish,  that  is, 

Gp  +  f 1  Hp  dr  =  0.  (2.26) 

Jo 

Now,  a  new  variable,  //,  is  introduced,  so  that  this  condition  can  be  rewritten 
as  follows 

/*'  =  -Hp{t,x,p,X)  (2.27) 

with  the  boundary  conditions 

po  =  0  (2.28) 

w  =  Gp.  (2.29) 

To  summarize,  the  first  variation  necessary  conditions  for  a  minimum 

X '  =  f(T,x,p) 

A'  =  -Hj(r,x,p,  A) 

=  —Hp(r,x,p,  A) 


are 


(2.30) 

(2.31) 

(2.32) 


10 

with  the  boundary  conditions 


T0  —  0,  Xq  —  X Qg 

(2.33) 

p0  =  0 

(2.34) 

Tf  =  1 

(2.35) 

</>(£/, p)  =  0 

(2.36) 

=  Gl,(Xf’P’l/) 

(2.37) 

PS  =  Gl(xf,p,v). 

(2.38) 

For  a  problem  with  %  states,  k  parameters,  and  l  terminal  constraints,  Eqs. 
(2.30)-(2.32)  are  2 i  +  k  equations.  From  Eqs  (2.36)-(2.38),  /  +  i  +  k  final 
conditions  are  obtained  which  allow  for  the  solution  of  the  constant  Lagrange 
multipliers  v  (/  unknowns),  the  parameters  p,  and  the  final  state  xj.  These 
equations  can  be  used  to  solve  for  the  remaining  constants  of  integration. 
Since  the  control  does  not  enter  into  the  endpoint  function  G,  the  condition 
in  Eq.  (2.38)  can  be  expressed  as 

Pui}  =  0  (2.39) 

PtJf  =  Gtf.  (2.40) 


2.3  The  First  Integral 


Since 


The  first  integral  can  be  calculated  quite  readily  from 

^  =  Ht  +  Hxx'  +  HpP'  +  Hx  V. 
dr 

x'  =  f,  Hx  =  f,  A'  =  -Hi,  p'  =  0, 


the  derivative  becomes 


dH_ 

—  XJT. 

dr 


(2.41) 


(2.42) 

(2.43) 


As  a  result,  if  H  does  not  contain  r  explicitly  (i.e.  H-, 
becomes 
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=  0),  the  first  integral 


H  =  Constant. 


(2.44) 


Chapter  3 


Neighboring  Extremal  Paths  for  Problems  with 
Parameterized  Control 

3.1  Introduction 

Neighboring  extremal  paths  are  those  which  lie  in  the  neighborhood 
of  the  extremal  path  and  which  satisfy  the  first  variation  conditions.  The 
purpose  of  analyzing  this  is  that  the  development  of  the  second  variation 
sufficient  condition  (Jacobi  condition)  follows  from  the  analysis  of  these  paths. 
In  this  chapter  the  neighboring  extremals  are  developed  and  analyzed  using 
the  backward  sweep  method. 

3.2  Neighboring  Extremals  for  Problems  with  Param¬ 
eterized  Control 

Given  an  extremal  path,  that  is,  one  which  satisfies  the  first  variation 
necessary  conditions  derived  in  Chapter  2,  an  admissible  comparison  path  is 
one  which  lies  in  the  neighborhood  of  the  extremal  and  satisfies  all  of  the 
constraints. 

Suppose  there  exists  a  neighboring  extremal  path  from  a  point  xg.  = 
xg  +  8xg  at  time  tq  to  a  neighboring  terminal  constraint  manifold  =  ip  + 
Sip.  This  is  illustrated  in  Figure  3.1.  Then,  an  admissible  comparison  path 
is  formed  by  letting  8xq  and  8rp  go  to  zero.  If  the  subscript  1  denotes  a 
neighboring  extremal  path,  the  following  conditions  must  hold: 

xi  =  /(r,X!,pi) 
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(3.1) 
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Figure  3.1:  Neighboring  Extremal  Paths 

V  =  Ax)  (3.2) 

l*i  =  i,Pi,Ai)  (3.3) 

0(*i,, Pi)  =  0,  A1;  =G^/(x1/,p1,i/i),  =Gj’(a:i/,p1,i/1)  (3.4) 

xi0  =  sriuen,  /*i0  =  0,  r0  =  0,  r/  =  1  (3.5) 

Since  xx(t)  is  a  neighboring  path  to  x(t), 

xx  =  x  +  <5x,  Ax  =  A  +  6\,  vi  =  v  +  8i>,  pi  =  p  +  8p.  (3.6) 


If  these  equations  are  substituted  into  Eqs.  (3.1)-(3.4),  expanded  in  a  Taylor 
series,  and  higher  order  terms  (higher  than  one)  are  neglected,  the  resulting 
equations  become 


Sx' 

=  fJx  +  fp8p 

(3.7) 

8\' 

=  —Hxx8x  —  fx8\  —  Hxp8p 

(3.8) 

6p' 

=  —Hpx8x  -  fj8X  -  Hpp8P 

(3.9) 
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S\f  = 

G x fx jSx j  4"  ipXfSu  4*  GxjpSp 

(3.10) 

Sip  = 

ipxfSxj  +  ippSp 

(3.11) 

%  = 

:  GpXfSxf  4 -ippSi/  +  GpPSp. 

(3.12) 

In  addition,  the  initial  conditions  are 

Sx0  =  given 

(3.13) 

6  go  =  given 

(3.14) 

In  expressing  Eqs.  (3.8)-(3.12),  the  following  relations  have  been  used: 

HxX  = 

Q 

H 

II 

li 

«■ 

*  S 

(3.15) 

Eqs.  (3.7)-(3.9)  can  be  rewritten  as 

Sx' 

=  ASx  4-  DSp 

(3.16) 

SX' 

=  -CSx  -  AtS\-  ESp 

(3.17) 

Sp' 

=  —EtSx  —  DTS\  —  FSp 

(3.18) 

where 

A  =  fx 

(3.19) 

C  =  Hxx 

(3.20) 

D  =  fP 

(3.21) 

E  =  Hxp 

(3.22) 

F  =  Hpp. 

(3.23) 

Also,  Eqs.  (3.10)-(3.12)  can  be  expressed  as 

6Xf  = 

-  Gx jX jSx j  4"  ipXfSis  4"  GxjpSp 

(3.24) 

Sip  = 

=  ipxjSxj  +  OSv  +  ippSp 

(3.25) 

%  = 

=  Gpx{Sxf  4-  ippSv  4-  GppSp. 

(3.26) 
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3.3  The  Sweep  Method 


One  way  of  solving  the  above  linear  two-point  boundary- value  prob¬ 

lem  is  called  the  sweep  method.  This  technique  hypothesizes  that  the  solution 

is  of  the  form  of  the  final  conditions,  i.e. 

8\  —  S(t)8x  +  R{t)8v  +  m{r)8p 

(3.27) 

8i[>  =  T{t)8x  +  Q(t)8u  +  n{r)8p 

(3.28) 

8p  =  /3(t)8x  +  ^{t)8v  +  a(r)8p 

(3.29) 

where 

Sj  =  Gxjxj 

(3.30) 

Rf  = 

(3.31) 

TTl  J  7  GXjp 

(3.32) 

II 

-s- 

H 

(3.33) 

Qf  =  o 

(3.34) 

«/  =  ’/’p 

(3.35) 

—  Gpx  j 

(3.36) 

II 

(3.37) 

p 

II 

(3.38) 

Differentiating  Eq.  (3.27)  yields 

8\'  =  S'8x  +  S8x'  +  R'8v  +  m'8p. 

(3.39) 

Substituting  for  8x'  and  8\'  from  Eqs.  (3.16)  and  (3.17),  respectively,  yields, 
—  C8x  —  At8X  —  E8p  =  S'8x  +  S(A8x  +  D8p)  +  R'8v  4-  m'8p.  (3.40) 
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Substituting  for  6X  from  Eq.  (3.27)  and  collecting  terms  produces 

0  =  (S'  +  C  +  SA  +  AtS)8x  +  (Bf  +  AtR)8v 

+(m'  +  E  +  SD  +  ATm)8p.  (3.41) 

Since  this  equation  is  valid  for  all  variations  in  x ,  v ,  and  p,  S,  R,  and  m  are 
chosen  such  that  each  of  the  coefficients  of  the  variations  must  be  zero,  that 
is 


S'  = 

- ATS  -SA-C, 

Sj  —  Gxfxj 

(3.42) 

R'  = 

- atr , 

& 

II 

(3.43) 

m'  — 

-ATm  -SD-E, 

TTI  f  —  GX}J>. 

(3.44) 

Notice  that  since  C  and  GXfXJ  are  symmetric  and  since  the  differential  equation 
for  ST  and  the  corresponding  boundary  condition  are  the  same  as  for  S,  S  = 
<ST,  which  means  that  S  is  symmetric. 

Similarly,  differentiating  Eq.  (3.28),  with  8ip'  —  0,  gives 

0  =  T'8x  +  T8x  +  Q'8v  +  n'8p.  (3.45) 

Substituting  for  8x',  yields 

0  =  T'8x  +  T(A8x  +  D8P )  +  Q'8v  +  n'8p.  (3.46) 

Accumulating  the  coefficients  of  the  common  variations  produces 

0  =  (T’  +  TA)8x  +  (Q')8v  +  (n'  +  TD)8p.  (3.47) 

As  before,  T ,  Q,  and  n  are  chosen  such  that  the  coefficients  of  the  variations 
vanish.  This  results  in  the  following  set  of  equations  with  the  associated 
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boundary  conditions 


-Si¬ 

ll 

>'=tf 

bs 

1 

II 

(3.48) 

Q'  =  0,  Q/  =  0 

(3.49) 

n'  =  — TD ,  nf  =  ipp. 

(3.50) 

Finally,  differentiating  Eq.  (3.29),  yields, 

8p'  —  /3'8x  +  /38x'  +  'y'Su  +  a'6p.  (3.51) 


Substituting  for  Sx'  and  8p'  from  Eqs.  (3.16)  and  (3.18),  respectively,  yields 

-  Et6x  -  DT8X  -  F6p  =  p'Sx  +  P(A8x  +  D8p)  +  i8v  +  a'8p.  (3.52) 

Substituting  for  8X  from  Eq.  (3.27)  and  collecting  terms  produces 

0  =  (/?'  +  Et  +  pA  +  DtS)8x  +  (V  +  DtR)8u 

+(<*'  +  F  +  0D  +  bTm)8p.  (3.53) 

This  yields  the  three  equations 

/3'  =  -pA-DTS  -ET,  ftp  =  GpXf  (3.54) 

i  =  -DtR,  7/  =  #  (3.55) 

a'  =  -DTm-  /3D  -  F,  af  =  Gpp.  (3.56) 

Notice  that  the  differential  equations  and  boundary  conditions  for  RT  and 
T,  mT  and  /?,  and  nT  and  7,  respectively,  are  the  same;  therefore,  T  =  RT, 
(3  =  mT,  and  7  =  nT. 

To  summarize,  the  differential  equations  for  S,  R,  Q,  m,  n ,  and  a 
and  their  respective  boundary  conditions  are 


S' 


-ATS  -  SA-C ,  Sf  =  GXfXf 


(3.57) 
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R! 

=  -AtR, 

Rf 

h  iT 

II 

(3.58) 

rri 

=  —ATm  - 

- SD-E , 

nif 

—  Gxjp 

(3.59) 

n' 

=  ~RtD, 

nj 

=  V’p 

(3.60) 

a.' 

=  -DTm- 

-  mT D  -  F, 

as 

=  Gpp 

(3.61) 

Q 

=  0. 

(3.62) 

dimension  of 

i  x  i,  R  has 

a  dimension 

of  i  : 

x  /,  Q  has 

a  dimension  of 

/  x  l,  m  has  a  dimension  of  i  x  k,  n  has  a  dimension  of  l  x  k,  a  has  a  dimension 
of  k  x  k. 


3.4  The  Neighboring  Extremal  Parameterized  Con¬ 
trol 


Eqs.  (3.27)-(3.29)  can  be  written  in  matrix  form  as 

8X  1  [  S(t )  R(t)  m(r)  '  6x 

Sip  =  RT  (r)  0  n(r)  8u  .  (3.63) 

8fi  mT(T )  nr(r)  a(r)  _  8p 

The  last  two  equations  of  the  matrix  can  be  written  in  the  form 

^  1  =  UT8x  +  V  [  Sf  (3.64) 

Ofi  J  [Op 

where 


U  =  [  R{t)  m(r)  ]  , 

(3.65) 

17  a  [  0  n(r) 

nT(r )  cn(r) 

(3.66) 

Therefore,  if  V-1  exists, 

H  =-V-1Ut8x  +  V-1\6/  . 

op  [  Oji 

(3.67) 
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Eq.  (3.27)  can  be  rewritten  as 

8X  =  SSx  +  U  Sgv  .  (3.68) 

Use  of  Eq.  (3.67)  results  in  the  following  equation: 

6\  =  (S -UV-'U^Sx  +  UV'1  ^  .  (3.69) 

If  6x o  and  <$/i0  are  given,  this  specifies  £A0  and  therefore  Sx ,  S\  and  Sfi  can 
be  obtained  as  a  function  of  r.  Since  the  matrix  and  the  components  of  V~l 
appear  repeatedly  in  this  analysis,  it  is  useful  to  define  and  partition  it  as 

y-’=  °T  ‘  (3.70) 

where  a  is  of  the  same  dimension  as  Q  =  0  (/  x  /),  b  is  of  the  same  dimension 
as  n  (/  x  &),  and  c  is  the  same  dimension  as  a  (k  x  k ).  The  matrix  V~l  is 
symmetric  because  V  is  symmetric.  In  addition,  S  is  defined  as 

S  t  S  -UV~lUT  (3.71) 

and  <5$  is  defined  as 

» = [  Z  ]  •  (3-72) 

If  the  definitions  in  Eqs.  (3.65)  and  (3.70)  are  used,  the  variations  8v  and  8p 
can  be  written  as 

8v  =  — ( aRT  +  bmT)8x  +  b8fi  +  a8rp  (3.73) 

8p  =  ~(bT  Rt  +  cmT)8x  +  c8p  +  bT8xJ>.  (3-74) 

The  quantities  Rb  +  me  and  Ra  +  mbT  appear  consistently  and  are  defined  as 

M  =  bT Rt  +  cm T  —  [  bT  c  j  UT  (3.75) 

N  =  aRT  +  bmT  =  |  a  b  j  UT .  (3.76) 
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Therefore,  8v  and  8p  can  be  expressed  as 

8p  =  —M8x  +  c8p  +  bT  8xp  (3.77) 

8u  =  —N8x  +  b8p  +  a8ip.  (3.78) 

Eq.  (3.77)  is  the  neighboring  extremal  parameterized  ‘control’  law  for  neigh¬ 
boring  extremal  trajectories. 

If  the  definitions  of  S,  V -1,  M,  and  N  are  used,  the  differential 
equation  for  8p  is  expressed  as 

V  =  -  (Hpx  +  fpS  -  HPPM)  8x  -  (HppbT  +  NT)  8i> 

—  {Hppc  +  AfT)  8p  (3.79) 

or  equivalently  as 

8p!  =  -  (EJ  +  DTS  -  FM)  8x  -  (FfeT  +  DtNt)  8rp 

-  ( Fc  +  DtMt )  8p.  (3.80) 

The  differential  equations  for  V-1,  S,  M,  and  N  are  developed  in 
great  detail  in  Appendix  A. 


Chapter  4 


Sufficient  Conditions  for  Problems  with 
Parameterized  Control 

4.1  Introduction 

In  order  to  investigate  whether  a  particular  set  of  parameters  is  min¬ 
imizing  (or  maximizing),  the  second  variation  must  be  investigated.  The  con¬ 
ditions  which  arise  from  this  investigation  can  be  used  to  determine  whether  a 
particular  parameterized  control  set  which  satisfies  the  first  variation  necessary 
conditions  (hence  is,  at  most,  an  extremal  set  of  parameters),  will  minimize 
the  performance  index.  First,  the  second  variation  will  be  derived  from  the 
first  variation.  Next  the  sufficient  conditions  will  be  expressed  in  terms  of  the 
Jacobi  (conjugate  point)  condition. 

4.2  The  Second  Variation 

Recall  that  the  first  variation  was  expressed  in  Eq.  (2.20)  as 

SJ  =  {GXj  —  A  'j'jSxf  +  Gp6p  +  GySv  +  Xq8xo 

+  jf1  \(HX  -  A t,)8x  +  Hp8p  +  ( f  -  xt')6A]  dr.  (4.1) 

The  second  variation  is  obtained  by  taking  the  variation  of  the  first 
variation,  that  is 

62J  =  6x^GXjX}8xf  +  6x^GXfP8p  —  Sx^SXj  +  8pTGpXj6xf 
+8pTGpp6p  +  8^t8v  +  {8xT  GXjV  +  8pT  Gpi/)  8  v 
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+6\q6x0  +  XqS2X0  +  &VT  {GvxjbXf  +  Gup8p} 

+  f  6xt Hxx8x  +  SxT  Hx\8X  4-  8xT Hxp8p 
Jo 

—8xt8\'  +  8pTHpx8x  +  8pTHp\8X  +  8pT  Hpp8p 
+8XT(fx8x  +  fp8p  -  8x')  dr.  (4.2) 

Upon  integration  by  parts  of  8xT8X'  and  making  use  of  Eqs.  (3.7) 
and  (3.15),  as  well  as  the  constraints,  Eqs.  (3.11)  and  (3.27)  (with  82x0  =  0), 
the  second  variation  is  reduced  to 


82J 


=  8xTj  8pT 

+  £[6xt  SpT] 


XjXf 


G. 

G, 


xjp 

i 

PP 


Hxx  H, 
Hpx  H, 


8xf 

8p 


Xp 


W  J  L 


8x 

8p 


dr. 


(4.3) 


4.3  The  Perfect  Differential 

Now,  analyze  a  perfect  differential  of  the  form, 

p  =  —\8xTS8x  +  8xTUV-18<f>  +  8$TV-1UT8x-8$TV-18$]  (4.4) 
dr  L  J 

=  — -  \8xTS6x  +  8xTMT8p  +  8pTM8x  +  8xTNT8p 
dr  L 

+8pTN8x  —  8pTa8p  —  8pTb8p  —  8pTbT8p  —  8pTc8p J  .  (4.5) 

Now,  introduce 

8x  =  fx8x  +  fp8p  =  A8x  +  D8p.  (4.6) 

P  can  be  expanded  to  yield, 

p  =  8xT  (^AT S  +  SA  +  S'^  8x 8pT DT S8x 
+8xTSD8p  +  8xt  (mTi  4-  ATMT'j  8p 
+8[xT  ( M '  +  MAj  8x  +  8pT DT Mt 8p 
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+SpT  MDSp  +  SpT  DT  NT  Sip 
+SiPTND6p  +  SipT  (N'  +  NA)  6x 
+SxT  (NTI  +  AtNt )  Sip 
—SpTl  i^—MSx  +  bT Sip  +  cSpj 
—  SxT Mt  +  SipTb  -f  SpTcj  Sp! 

—SipT  a!  Sip  —  SipTb'Sp  —  SpTbr'Sip 

—SpTcSp.  (4-7) 

If  certain  terms  are  added  and  subtracted  in  the  perfect  differential, 
P  can  be  further  expanded  as  follows 

P  =  SxT  [ATS  +  5A  +  S’  +  C  -  Hxx  -  EM  -  MtEt 
+MtFM  -  SDM  -  MtDtS  +  MtHppm\  Sx 
+SxTSfpSp  +  SpTfpSSx  +  SpTMfvSp  +  SpT  fpMTSp 
+SxT  [NT/  +  AtNt  +  SDbT  -  MtDtNt  -  MTFbT 
+EbT  -  MTHppbT ]  Sip  +  SipT  [iV'  +  NA  +  bDTS 
+bET  -  NDM  -  bFM  -  bHppM ]  Sx 
+SxT  [mTi  +  AtMt  +  Ec+  SDc  -  MtDtMt 
-MtFc  -  MtHppc ]  Sp  +  SpT  \M'  +  mA 
+cDtS  -  MDM  -  cFM  +  cEt  -  cHppM ]  Sx 
■+SipT  V  +  NDc  +  bDTMT  +  bFc  +  fei/ppc]  Sp 
+SpT  [ -bT'  +  cDtNt  +  MDbT  +  cFbT  +  cHppbTj  Sip 
+SiPT  [-o'  +  NDbT  +  bDTNT  +  bFbT  +  bHppbT\  Sip 
+SpT  [— c'  -f  MDc  +  cDtMt  +  cFc  +  cHppc\  Sp 
+SpTf^NTSiP  -  [SpTl  +  SxT  (Hxp  +  Sfp  -  MtHpp) 
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+8^T  ( bHpp  +  Nfp)  +  8pT  (cHpp  +  M/p)] 

•  [—M8x  +  bT8xp  +  c8[ij  —  (^—8xtMt  +  8i(?T b  +  8pTcj 
■  [6p'  +  (Hpx  +  fj§-  HpPM )  8x  +  (j HppbT  +  /pT Nt)  8rP 
+  ( HppC  +  fpMT^  <$/i]  +  8ipT N fp8p  (4.8) 

Recognizing  certain  terms  in  P  as  the  neighboring  extremal  parameters  as 
follows, 


8p  =  —M8x  +  c8p  +  bT8xl>, 


(4.9) 


and  adding  and  subtracting  P  and  ( 8pT,8p  +  8pT8p'^j  to  the  second  variation 
defined  in  Eq.  (4.3),  82J  becomes, 


GxjXj  GXjp 
Gpxf  Gpp 


8xf 

8p 


82J  =  [  8xTj  8pT  ] 

+  £{(8p-8p)THPp(8p-8p) 

+8xt  [5'  +  ATS  +  SA  +  C  -  EM  -  MtEt 

+MtFM  -  SDM  -  MtDtS }  8x  +  8xT  [nTi 

+AtNt  +  SDbT  -  MtDtNt  -  MTFbT  +  EbT ]  8 

+8^>  [iV'  +  NA  +  bDTS  -  NDM  -  bFM  +  bET ]  8x 

+8xt  [mT/  +  AtMt  +  SDc  -  MtDtMt  -  MtFc  +  Ec ]  8p 

+8pT  \M'  +  MA  +  cbTS  -  MDM  -  cFM 

+cEt ]  -  8^t  [a'  -  NDbT  -  b£)TNT  -  bFbT ]  Sif? 

-8xpT  [b1  -  NDc  -  bDT Mt  -  bFc ]  8p 
-8pT  [bTl  -  MDbT  -  cDtNt  -  cFbT ]  8xJj 
-8pT  fc'  -  MDc  -  cDtMt  -  cFc ]  8p 
+  [8fiT'  +  8xt  (Hxp  +  Sfp  -  MtHvp) 
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+8^T  (bHpp  +  Nfp )  +  8gT  ( cHpp  +  M/p)]  (<5p  -  Sp) 

+  (<5pT  -  <5pT)  [V  +  (tfpx  +  /JS-  HppM )  6x 

+  (j HpPbT  +  f*NT)  ty  +  (#PPc  +  fjMT)  8p\ 

—8pT8p!  -  8pT'8p  -  4-  [ 8xTS8x  +  8xTUV~l8§ 
dr  L 

8$TV~lUT8x  -  <5$Ty1^]}  dr.  (4.10) 


Now,  5,  M,  N,  a,  b,  c,  and  8p  are  chosen  to  satisfy  the  following  relations, 


similar  to  the  reasoning  in  Bryson  and  Ho  [4], 

S'  =  -ATS  -  SA-C  +  EM  +  MtEt 

-MtFM  +  SDM  +  MtDtS  (4.11) 

M'  =  -MA-cDTS  +  MDM  +  cFM  -  cET  (4.12) 

N'  =  -NA-bDTS  +  NDM  +  bFM  -bET  (4.13) 

a'  =  NDbT  +  bDTNT  +  bFbT  (4.14) 

b'  =  NDc  +  bDTMT  +  bFc  (4.15) 

c'  =  MDc  +  cDT  MT  +  cFc  (4.16) 

V  =  -  (Hpx  +  fjs  -  HppM)  8x  -  (HppbT  +  fjNT)  8x8 

-(HppC  +  fjMT)8p  (4.17) 


with  the  following  boundary  conditions 


s, 

[NJ  MJ] 


=  G 


XfXf 


0 


-  [  G  X  ]P  ] 

L  ' 

UfVf1  =  [  GXfP  ]  [  0 


V’p 


G. 


-i  r 


1  ... 

a, 

*/' 

o 

k 

c/ . 

^ p  Gpp 

vr  = 


T 

P 

-1 


PP 

V’p 

Gpp 


<5p/  =  Gpx/^ ;  +  V>p  8v  +  Gpp<5p 


V’x, 

G 


pxp 


6p0  =  given , 


(4.18) 

(4.19) 

(4.20) 

(4.21) 

(4.22) 
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where  the  bar  over  p  and  v  denotes  those  quantities  correspond  to  the  neigh¬ 
boring  extremal  trajectory  which  terminates  at  the  same  location  on  the  ter¬ 
minal  constraint  manifold  as  the  admissible  comparison  path.  Using  these 
relations,  the  second  variation  becomes 


+  {(6p  -  8pf  Hpp  ( 8p  -  6p)  -  SpT  8  p!  -  6f6p 

-4-  \8xTS6x  +  SxTUV~1S^  +  8§TV~lUT8x 

dr  L 

8$]}  dr.  (4.23) 

Recognizing  that  the  second,  third,  and  fourth  terms  can  be  integrated  di¬ 
rectly,  the  second  variation  can  be  further  reduced  to 


-  [8pT8p  +  8pT8p]lo  -  [<5xTS<5:r  +  SxTUV~18 $ 
+8<f>TV~1UT8x  -  «5$Ty_1  8 $]* 

+  / 1  (8p  -  Spf  Hpp  (8p  -  6p)  dr.  (4.24) 

Jo 

The  terms  outside  the  integral  are  separated  into  those  at  the  initial 
time  and  those  at  the  final  time  as  follows: 

82J  =  Y0  +  Yf+  4  (8p  -  Spf  Hpp  (6p  -  Sp)  dr  (4.25) 

Jo 

where  Y0  and  Yj  are  defined  by 

Y0  =  8pT8pQ  +  8pf8p  +  8x^  S08x0  +  8x^U0V~18^0 

+8^V~1Uj8x0  -  8$T0V~H$0  (4.26) 

Yf  =  8x'jGXjXj8xf  +  8xTsGXfV8p  +  8pTGpX}8xj  +  8pTGw8p 

—8pT8pj  —  8/j/f8p  —  8xTfSj8xf  —  Sx^UjV^S^j 

-SQjVf'UjSxf  +  StfVf'SQj. 


(4.27) 
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After  substituting  for  pf,  Sj,  UjV}  x,  and  Vf  x,  Eq.  (4.27)  is  rewritten  as 


Yf  =  8pTGpp8p  -  8pT  \^8v  +  Gpp8p\  -  {8i/Tipp  +  8pGpp\  8p 
+8xTf  |  [  Vx,  GXfP  ]  .  °  .  GXJxj  | 


*'  8x 


-SxTt  [  GIJP  ] 

+i^^i  °^0*n*«]- 


(4.28) 


Recall  that  on  the  neighboring  extremal  path,  Eq.  (3.64)  evaluated  at  the 


final  time  is  expressed  as 


X}  \6xf  =  - 


^  i  r  & 


Gp 


Eq.  (4.29)  is  used  to  reduce  Eq.  (4.28)  to 


(4.29) 


Yj  =  ipTGrrSp  -  6pTGrp6p-6pTGrr6p -6pTi>l6t/ -  S^iipSp 

+  {~K  ^l["j  £  ]  +  I  ^  ^l}' 


0  Vp 
Gpp 


v>P  l  r  8v 


V*  Gp 


-{~K  spoilt  ot  ] +  [  HT  ^1} 

■[!f<£r[5H*  *'][!?£ 


■  -1  r  8V 

L 

fpP]\  8v 


0  V>P 
Gpp 


(_  0  V’p  8v  8xj) 

\  [  Vv  Gpp  J  [  Sp  J  +  [  8pf 

+  K  **][*  g’S  ’ 


(4.30) 


which  simplifies  to  yield 


Yj  =  8pTGpp8p-8pTGpp8p-8pTGpp8p-8pTxl>p8v 
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4>p 


%  G. 


pp 


Sv 

Sp 


—SvT  ipp8p  +  SvT  6pT 

which  further  reduces  to 

Yf  =  ( 6p  -  Sp)T  Gpp  (Sp  -  Sp)  -  (Sp  -  Sp)T  ipp8i> 
—SvTipv  (Sp  —  Sp) . 


(4.31) 


(4.32) 


At  the  terminal  constraint  manifold,  the  neighboring  extremal  and 
the  admissible  comparison  path,  respectively,  must  satisfy  the  following  equa¬ 
tions 

0  =  ipXfSxf  +  ippSp  (4.33) 

0  =  ipXf8x  f  +  ippSp,  (4-34) 

Therefore,  if  these  two  equations  are  subtracted,  the  resulting  equation  is 

ipp  (Sp  —  Sp)  =  0  (4.35) 

With  this  relation,  Yj  can  be  finally  reduced  to 

Yf  =  (Sp  -  Sp)T  Gpp  (Sp  -  Sp) .  (4.36) 

Similarly,  Y0 ,  from  Eq.  (4.26),  is  written  as 

Y0  =  SpTSpa  +  Sp^Sp  +  Sx^SSxo  +  SxT0U 0V~l  S<P 

+S$TV0-lUj8x0  -  S^V-'S®  (4.37) 

=  SpTSp0  +  SpT0  Sp  +  SxT0SSx0  +  SxT0Nj  Sip 

SipT  N0Sx0  +  Sx^MjSp0  +  8pT0M08x0  -  SxpTa0Sip 
-Sp^boSip  -  SipTb^Sp0  -  SpT0c0Sp0  (4.38) 

Since  Sp0  =  0  and  Sip  =  0,  Y0  becomes 

Y0  = 


SxlS0Sx0 


(4.39) 
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V  =  VS 


Figure  4.1:  Admissible  Comparison  Paths 

Therefore,  using  Eqs.  (4.36)  and  (4.39),  the  second  variation  in  Eq.  (4.25) 
becomes 

82J  =  8xT0S08x0  +  (8p  -  8pf  [Gpp  +  £  Hpp  dr]  (Sp  -  8p) .  (4.40) 

For  an  admissible  comparison  path,  that  is  one  which  lies  in  the 
neighborhood  of  the  extremal  and  which  satisfies  all  the  constraints,  Sx0  =  0, 
SxJ)  =  0,  and  8fi0  =  0.  Therefore,  if  S0  and  U0Vj~l  are  finite  over  [0,1),  the 
initial  point  term  outside  the  integral  in  Eq.  (4.40)  vanishes  and  the  second 
variation  reduces  to 

82 J  =  ( 6p  -  8pf  \gpp  +  C  Hpp  dr]  ( 8p  -  8p) .  (4.41) 

L  Jo 

Hence,  if  Gpp  +  Hpp  dr  >  0  ,  the  second  variation  is  positive  for  arbitrary 
variations  8p,  unless  8p  =  8p.  This  can  occur  only  if  the  admissible  comparison 
path  is  a  neighboring  extremal.  However,  Eq.  (3.69)  indicates  that  for  SD  and 
UoV-1  finite  and  8xa  =  0,  8p0  =  0,  and  Sip  =  0,  this  results  in  8\0  =  0. 
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With  this,  Eq.  (3.77)  reduces  to  8p  =  0.  Therefore,  Eqs.  (3.16)  -  (3.18) 
simplify  to  8x  =  8X  =  8p  =  0,  which  implies  that  8p  =  0,  or  that  there  is  no 
admissible  comparison  path  which  is  a  neighboring  extremal  path.  Therefore, 
the  extremal  path  is  a  minimum. 

On  the  other  hand,  if  S0  and  U0V~X  become  infinite,  8x0  =  0,  8p0  = 
0,  and  8%f  =  0  could  lead  to  a  finite  8\0  and  an  admissible  comparison  path 
which  is  a  neighboring  extremal.  Therefore,  the  second  variation  could  become 
negative  and  the  extremal  path  is  not  a  minimum.  This  is  also  the  case  when 
S,  UV~X,  and  V-1  become  infinite  at  some  point  within  the  interval.  If  this 
happens,  this  point  is  called  a  conjugate  point. 

The  sufficient  conditions  are  formulated  from  the  operations  needed 
to  form  82J  as  a  perfect  square.  In  addition,  since  a  perfect  differential  is 
added  to  the  second  variation,  S,  UV -1,  and  V~x  must  be  finite  for  a  finite  8x 
and  6$  to  lead  to  a  finite  8v  and  8p ,  as  well  as  to  a  finite  8\.  These  conditions 
can  also  be  stated  as  requiring  that  the  derivatives  of  S,  UV~X ,  and  V~l  be 
integrable  or  S,  UV~X,  and  V~x  be  finite  over  [0,1).  The  following  theorem 
states  the  sufficient  conditions. 

Theorem  1  If  the  first  variation  necessary  conditions  for  a  minimum  are 
satisfied  and  the  following  conditions  are  satisfied, 

1)  Gpp  +  /o  HpP  dr  >  0, 

2)  S  finite  over  0  <  t  <  1, 

3)  UV~l  finite  over  0  <  r  <  1,  and 

4)  finite  over  0  <  r  <  1, 
then  this  solution  is  a  minimum. 


31 


A  special  case  of  this  theorem  arises  when  tf  only  appears  linearly 
in  the  variational  Hamiltonian,  H,  and  the  endpoint  function,  G.  In  this  case, 
Htjtj  and  Gtft}  are  identically  zero.  Therefore, 

H,,,r  =  (4.42) 

ls 

where  up  refers  to  the  set  of  parameterized  controls  which  excludes  tf. 


The  first  condition  in  Theorem  1  becomes 


o 

o 

1 - 

H 

[o  °. 

+  Jo 

H% 


Hi 


Hu 


UpUp 


dr  >  0. 


(4.43) 


However,  from  the  first  variation, 


£  HUp  dr  =  0.  (4.44) 

Therefore,  Condition  1  in  Theorem  1  can  be  reduced  to 

Jo  HUpUpdr  >  0. 


(4.45) 


Chapter  5 


Application  of  the  Sufficient  Conditions  to  a  Missile 

Intercept  Problem 


In  this  chapter  the  sufficient  conditions  for  a  minimum,  obtained  in 
Chapter  4,  are  applied  to  a  missile  intercept  problem.  First,  the  missile  model, 
which  includes  the  thrust  and  aerodynamic  characteristics,  is  presented.  The 
optimization  problem  is  described  and  the  resulting  first  variation  conditions 
are  presented.  Two  realistic  missile  engagement  scenarios  are  presented.  The 
first  case  is  for  a  target  toward  the  launching  aircraft  and  the  second  is  for  a 
target  moving  away  from  the  launching  aircraft.  The  matrices  required  in  the 
application  of  the  second  variation  conditions  are  presented  and  the  sufficient 
conditions  for  a  minimum  are  applied  to  this  solution  to  determine  whether  it 
is  indeed  a  minimum. 

5.1  The  Missile  Model 

The  model  used  to  verify  the  sufficient  conditions  is  a  EMRAAT 
(Extended  Medium  Range  Air-to-Air  Technology)  -class  missile.  The  thrust 
and  aerodynamic  parameters  are  chosen  to  reflect  the  performance  character¬ 
istics  of  this  type  of  missile.  It  has  a  single  thrust  phase  which  produces  4000 
lb  and  has  a  duration  of  9.47  seconds.  The  drag  parameters  are  constant  and 
are  expressed  as  a  parabolic  drag  polar  of  the  following  form 

Cd  —  Cd0  +  KCj,  (5-1) 
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where 


CDo  =  0.4453  (5.2) 

I<  =  0.0171.  (5.3) 

At  launch,  the  missile  weighs  375  lb  and  at  engine  burnout  the  weight  reduces 
to  227  lb.  This  class  of  missiles  was  designed  to  be  used  for  ranges  between  20 
and  40  miles  at  altitudes  ranging  from  10,000  ft  to  50,000  ft.  The  atmosphere 
chosen  is  an  exponential  atmosphere  of  the  following  form 

P  =  Poe~h/h‘  (5.4) 

=  0.0023769  slugs/ft3  (5.5) 

=  23,800  ft.  (5.6) 

5.2  Equations  of  Motion 

The  two-dimensional  translational  equations  of  motion  are  used  to 
compute  the  trajectory  of  the  missile.  The  reason  for  this  is  that  it  was 
observed  that  even  when  the  full  three-dimensional  equations  were  used,  the 
missile  immediately  turned  into  the  plane  of  the  intercept.  The  equations  of 


motion  in  the  vertical  plane  are  as  follows 

x  =  V  cos  7 

(5.7) 

h  =  V  sin  7 

(5.8) 

T  D 

V  = - g  sin  7 

m  m 

(5.9) 

to  . 

O  ^ 

O  ^ 

I 

^  s 

II 

(5.10) 

where 


Po 

h  c 
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where  D  and  L  are 

D  =  l-PV2SCD 

(5.11) 

L  =  \pV2SCh 

(5.12) 

S  =  0.3068  ft2. 

(5.13) 

The  control  is  chosen  to  be  the  coefficient  of  lift,  Cl- 

5.3  The  Optimal  Control  Problem 

The  optimal  control  problem  can  be  stated  as  follows: 

Find  the 

coefficient  of  lift  which  maximizes  the  terminal  energy  at  target  intercept. 

Mathematically,  it  is  expressed  as  follows 

V) 

maximize  J  =  — 

2  9 

(5.14) 

subject  to  the  dynamics 

x  =  V  cos  7 

(5.15) 

h  =  V  sin  7 

(5.16) 

tV  t  pv2scd 

V  = - r  9  sm7 

m  Im 

(5.17) 

pVSCl  9  cos  7 

7  ~  2m  V 

(5.18) 

along  with  the  terminal  constraints 

o 

II 

o 

(5.19) 

h0  =  h0,  =  given 

(5.20) 

V0  =  Vo,  =  given 

(5.21) 

7o  =  7o3  =  9^en 

(5.22) 

xf  =  (Vt  cos  7t)  tj  +  xTq 

(5.23) 

hf  =  ( Vr  sin  7j)  +  hr0 

(5.24) 
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with  the  thrust  profile,  aerodynamics,  and  density  as 

T  =  4000  lb  for  t  <  9.47  seconds  (5.25) 

=  0  for  t  >  9.47  seconds  (5.26) 

Cd  =  Cd0  +  K  (5.27) 

p  =  Poe-h/h’.  (5-28) 


Sub-optimal  control  involves  finding  the  optimal  control  in  the  class 
of  piecewise  linear  controls  which  minimize  the  performance  index.  Therefore, 
the  coefficient  of  lift,  Cl ,  is  parameterized  into  nine  nodes,  four  in  the  thrust 
phase  and  five  in  the  coast  phase. 

In  addition,  since  the  final  time  is  not  specified,  it  is  included  in  the 
parameter  set  which  is  optimized.  This  is  done  by  transforming  the  problem 
into  a  fixed  final  time  problem  using  the  transformation  described  in  Eq.(2.6). 
The  dynamical  equations  become 


x  =  tfV  cos  7 

(5.29) 

h!  =  tfV  sin  7 

(5.30) 

T„  ±  (T  pV*SCD  .  ^ 

V'  -  t} - r  g  sm7 

\m  2m  ) 

(5.31) 

,  ,  ( pVSCl  g cos  7^ 

7  -  H  2m  V  )  ’ 

(5.32) 

The  Hamiltonian  and  the  end-point  function  are 

x  (T  pV2SCD 

H  =  XxtjV  cos7  +  XhtfV  sin7  +  Xytj  (  — - ^ - 9*mi 

y 2 

G  =  +  vx  [xj  -  (VT  cos  7 T)  tj  -  xTo] 

2  9 

+Vh  [hf  -  (Vx  sin  7r)  -  ^T0]  • 


(5.34) 
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The  coefficient  of  lift  is  obtained  from  the  relation 

CL  =  CLi  +  (CLi+1  -  CLi )  (5.35) 

The  Euler-Lagrange  equations  are  applied  to  this  problem  and  yield 

A*'  =  0 

A,  =  A ytfpV^SCp  t  A  1t1pVSCL 

h  2  mhs  2  mhs 

A v  —  —  Xxt  f  cos  7  —  Xhtf  sin  7  - 

X^tjpSCL  A7t  fg  cos  7 
2m  V2 

=  \xtjV  sin  i  —  XhtfV  cos 'j  +  Xytjg  cos -f 


(5.36) 

(5.37) 

(5.38) 

-  ±Mpi.  (5.39) 


The  boundary  conditions 

terminal  time  are 

associated  with  these  multipliers  at  the 

A Xf 

=  Vx 

(5.40) 

^hf 

=  Vh 

(5.41) 

A vs 

=  J2 

9 

(5.42) 

A7/ 

=  0. 

(5.43) 

The  Euler-Lagrange  equations  corresponding  to  the  parameters  are 


9cL 


/ 


— XxV  cos  7  —  A hV  sin  7  —  Ay 


pV^SCp 

2m 


(  pVSCjL  g  cos  7  ^ 

2m  V  7 

A vtjpV^SKCL  SCl  X^tjpV^  3Cl 
m  dCLi  2m  dCx, 


<7  sin  7 


) 


(5.44) 


(5.45) 


with  boundary  conditions 


o  = 


0 


(5.46) 
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\hS}  =  0 

(5.47) 

V'Clq  =  0 

(5.48) 

Q 

t- 

II 

o 

(5.49) 

5.4  Solution  of  the  Optimal  Control  Problem 

The  equations  described  in  the  previous  section  have  been  imple¬ 
mented  in  a  trajectory  simulation.  As  stated  earlier,  nine  control  nodes  were 
chosen,  four  in  the  first  (thrust)  interval,  and  five  in  the  second  (coast)  phase. 
The  optimal  trajectory  was  obtained  using  a  transition  matrix  based  shoot¬ 
ing  method.  This  technique  was  first  proposed  in  [8]  and  gives  the  optimal 
trajectory  for  parameterized  control  problems  relatively  easily.  The  advan¬ 
tage  of  this  method  is  that  the  dynamics  are  decoupled  from  the  guesses  of 
the  initial  Lagrange  multipliers.  The  penalty  paid  for  this  decoupling  is  that 
the  solution  obtained  is  not  the  true  optimal.  However,  Hull  and  Sheen  have 
demonstrated  that  the  sub-optimal  solutions  obtained  are  within  a  percent 
or  two  of  the  true  optimal.  Since  these  techniques  would  be  used  on  board 
aerospace  vehicles,  this  tradeoff,  between  computation  time,  effort,  and  accu¬ 
racy,  seems  to  favor  implementation  of  this  suboptimal  shooting  algorithm.  A 
complete  description  of  this  algorithm  is  presented  in  Appendix  C.  In  addition, 
a  sub-optimal  trajectory  simulation  is  developed  using  a  non-linear  recursive 
quadratic  programming  algorithm  called  VF02AD.  The  results  from  this  al¬ 
gorithm  for  the  optimal  trajectory  are  compared  with  that  obtained  from  the 
shooting  method.  Because  of  the  nature  of  the  algorithm,  extensive  scaling 
of  the  constraints  and  the  performance  index  is  done  to  ensure  convergence. 
The  convergence  criterion  for  both  sets  of  algorithms  is  chosen  to  be  10  8. 

Numerous  trajectory  simulations  have  been  carried  out  for  different 
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Figure  5.1:  Altitude  vs  Time,  Case  1 

launch  and  target  ranges  and  altitudes.  The  two  most  realistic  cases  are 
presented  to  demonstrate  the  usefulness  and  applicability  of  this  technique. 

In  both  cases,  both  the  launching  aircraft  and  the  target  are  at  40,000 
ft.  In  the  first  case,  the  target  is  initially  at  40  miles  moving  toward  the 
launching  aircraft  at  1,000  ft/sec.  In  the  second  case,  the  target  is  initially  at 
30  miles,  moving  away  from  the  target  at  1,000  ft/sec. 

5.4.1  Case  1:  Initial  Distance  40  miles,  target  closing  at  1,000 
ft /sec 

The  results  for  this  case  are  presented  graphically.  The  plots  include 
histories  of  altitude,  velocity,  flight  path  angle,  and  the  coefficient  of  lift. 
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Figure  5.4:  Coefficient  of  Lift  vs  Time,  Case  1 

5.4.2  Case  2:  Initial  Distance  30  miles,  target  moving  away  at 
1,000  ft /sec 

The  results  for  this  case  are  presented  below.  As  in  the  previous 
case,  the  histories  of  altitude,  velocity,  flight  path  angle,  and  coefficient  of  lift 
are  presented. 

The  plots  show  that  the  shooting  method  as  well  as  VF02AD  give 
similar  results  for  the  optimal  trajectories.  The  altitude  and  velocity  profiles 
are  almost  identical  for  the  two  techniques.  The  coefficient  of  lift  histories 
for  the  two  techniques  are  a  bit  different  owing  to  the  way  VF02AD  handles 
scaling  when  the  controls  are  close  to  zero.  The  shooting  method  gives  a 
reasonably  smooth  control  history.  As  expected,  if  the  number  of  control 
nodes  is  doubled,  the  control  history  is  more  smooth.  The  first  case,  in  which 
the  target  was  moving  toward  the  missile,  has  a  flight  time  of  about  48  seconds; 


43 


in  addition  the  missile  lofts  to  about  73,000  ft.  In  the  second  case,  in  which  the 
target  is  moving  away  from  the  missile,  the  flight  time  is  closer  to  72  seconds 
with  a  maximum  altitude  of  92,000  ft.  In  this  case  the  missile  travels  farther 
to  intercept  the  target,  so  it  lofts  higher  to  maximize  the  energy  at  intercept. 
These  results  seem  consistent  and  are  what  was  expected. 


5.5  The  Riccati  Equations 


The  Riccati  equations  are  integrated  for  the  cases  presented  in  the 
previous  section.  The  matrices  A-F  which  appear  as  part  of  the  equations  are 
defined  as  follows 


—  fx  —  tj 


0  cos  7 

0  sin  7 

qV2SCd  pVSCp 

2mhs  m 

(  pscl  i  a  -A 
2 mh,  V  2m  T  V2  ) 


—V  sin  7 
V  cos  7 
— g  cos  7 


(5.50) 


where 


C 


■  0  0  0  O' 

„  ,  0  Cx  C2  0 

ilxx-tf  0  ^  C3  Ca 

0  0  C4  C5  . 


(5.51) 


C !  = 
C2  = 

C3  = 

c4  = 

Cs  = 


X  •  ,  x  X  0Sln7 

—ax  sin  7  +  Xh  cos  7  -  A7  —  - 

.  g  cos  7 

-\XV  cos  7  -  XhV  sin  7  +  Avg  sin  7  +  A7 — — — 


(5.52) 

(5.53) 

(5.54) 

(5.55) 

(5.56) 
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D  =  /,= 


V  cos  7 

V  sin  7 

(5-^-«sin7) 

{  pVSCr.  _  ,g  cos  ->  \ 

L  \  2m  V  j 


0lx9 

0lx9 

ijpV^skcl  acr 

m  SCi, 
tjpV£  ac, 
2m 


where 


where 


E  =  Hxp  = 


0  0ix9 

E\  E2 
Ez  E4 
E5  0lx9 


_  \vpV2SCD  \lPVSCL 

1  t  I  z 


2m  h 


2mh , 


\  7  2 mhsJ  dC^i 


Ez  =  A*  cos  7  +  A/,  sin  7  — 


XvpVSCD 


m 


^XypSCL  A7<7  cos  7 

2m 

'V  y  m  2m)  SCL. 

Ez  —  —\XV  sin  7  +  A  cos  7  —  \vg  cos  7  +  —  1 


F  —  Hpp  ~ 


0  Ft 
FI  F2 


F  =  A vpVISKCl  OCl  A  1pVE  8Cl 
1  m  dCL,  +  2m  dCL, 

„  x  pV’S’/r  acL 
F ‘  =  -Xv—^-x£9cr: 

The  boundary  conditions  for  the  Riccati  equations  are 


(5.57) 


(5.58) 


(5.59) 

(5.60) 

(5.61) 

(5.62) 

(5.63) 

(5.64) 

(5.65) 

(5.66) 


G 


XfX, 


0  0  0  0 
0  0  0  0 
0  0  -i  0 
0  0  0  0 


(5.67) 
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m,j 


G. 


XjP 


■  1 

0  ■ 

0 

1 

0 

0 

.  0 

0  . 

■  0 

0lx9 

0 

0lx9 

0 

0lx9 

.  0 

0lx9 

(5.68) 


(5.69) 


nj 


1>p  = 


—vxVt  cos  7  0ix9 
-uhVTsm^  0ix9 


(5.70) 


af 


Gpp  — 


0  0ix9 
Ogxl  0gX9 


(5.71) 


The  Riccati  equations  (Eqs.  (3.54)-(3.59))  axe  integrated  using  these 
quantities  and  the  matrices  V-1,  UV~l ,  and  S  are  constructed.  At  each 
integration  step,  these  matrices  are  checked  to  make  sure  they  are  finite.  In 
addition,  at  the  end  of  the  integration,  the  eigenvalues  of  the  equation 

f  HCliCtir  (5.72) 

Jo  1  J 

are  tested  to  insure  positive  definiteness. 

Both  of  the  trajectories  described  above  had  matrices  which  are  finite 
and  the  eigenvalues  of  Eq.  (5.72)  are  positive.  The  eigenvalues  are  fisted  in 
Table  5.1. 


5.6  Summary 

In  this  chapter,  the  sufficient  conditions  are  applied  to  a  missile  in¬ 
tercept  problem.  The  first  variation  conditions  are  used  to  get  the  optimal 
trajectory.  Two  different  cases  are  investigated.  The  first  is  for  the  target 
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Case  1 

Case  2 

2.224  x  10"5 

2.052  x  10~5 

1.335  x  10~4 

1.223  x  lO"4 

3.463  x  10"4 

2.527  x  10"4 

3.851  x  10"4 

3.292  x  lO"4 

5.390  x  10"4 

4.066  x  10"4 

6.931  x  lO"4 

5.793  x  10"4 

8.018  x  10"4 

6.923  x  10~4 

1.261  x  lO"3 

1.292  x  lO"3 

1.430  x  10~3 

1.596  x  10~3 

Table  5.1:  Eigenvalues  Of  Eq.(5.72) 


moving  toward  the  launching  aircraft  and  the  second  is  for  the  target  moving 
away  from  the  launching  aircraft.  The  sufficient  conditions  for  a  minimum 
are  applied  to  both  these  trajectories  and  are  found  to  be  satisfied.  Therefore 
these  trajectories  are  minimal. 


Chapter  6 


First  Variation  Necessary  Conditions  for  Problems 
with  Parameterized  and  Nonparameter ized  Controls 

6.1  Introduction 

In  this  chapter  the  first  variation  necessary  conditions  are  derived  for 
optimal  control  problems  with  parameterized  and  nonpar ameteri zed  controls. 
First,  the  first  variation  necessary  conditions  are  derived.  The  first  integral  is 
obtained  directly  from  these  first  variation  necessary  conditions. 

6.2  The  First  Order  Necessary  Conditions 

For  the  class  of  problems  in  which  only  a  subset  of  the  controls  are 
to  be  parameterized,  the  optimization  problem  is  stated  as  follows 

minimize  J  —  </>{xf,p)+  [  L(T,x,u,p)dT  (6.1) 

Jo 

subject  to  the  differential  constraints 

x'  =  f(r,x,u,p)  (6.2) 

and  the  terminal  constraints 

ij>(xf,p)  =  0  (6.3) 

with  the  initial  conditions 

xo  =  x0,  =  given  (6.4) 
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where,  as  before,  p,  containing  the  parameterized  control  and  the  final  time 
(if  it  is  free)  is  defined  as 


A 

P  = 


Ul 

Uk- 1 

tf  J 


(6.5) 


where,  as  before,  A:  —  1  is  the  number  of  parameterized  control  nodes.  This 
formulation  of  the  performance  index  will  be  used  henceforth. 


The  constraints  are  adjoined  to  the  performance  index  using  La¬ 
grange  multipliers  and  it  is  expressed  as 

J  =  G(xj,p,v)  +  J  \H(t,x,u,p,  A)  -  Atx']  dr  (6.6) 

where 


G{xj,p,  v)  =  <f>{xf,p)  +  vTil>{xf,p) 
H(t,x,u,p,  A)  =  L(r,x,u,p)  +  \T  f(r,x,u,p). 


(6.7) 

(6.8) 


In  order  to  obtain  the  first  variation  necessary  conditions,  the  vari¬ 
ation  of  Eq.  (6.6)  is  taken,  yielding 

8J  =  GXf6xf  +  GpSp  +  Gv8v  +  J  [Hx6x 

+Hu8u  +  Hx8\  +  Hp6p-8\Tx' -\T8x']  dr.  (6.9) 

After  the  A T8x'  term  is  integrated  by  parts,  the  first  variation  becomes 

8J  =  (GXj  —  Xj)8xj  +  Gp8p  4-  Gv8v  -1-  -t-Ag 8xq 

f1  \(HX  +  A t,)8x  +  HJu  +  Hp8p  +  ( f  -  xr,)<5A]  dr  (6.10) 

J  0 

which  is  further  simplified  using  Eqs.  (6.2)  and  (6.3)  (with  8x o  =  0)  to 
8J  —  (GXj  —  Xj)8xj  Gp8p  +  f  [(i/x  d-  ^  )$x  d-  Hu8u  -|-  dr.  (6.11) 

J  o 
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Now,  the  Lagrange  multipliers,  A,  are  chosen  such  that  the  coefficients  of  the 
dependent  variations  (8x)  vanish,  that  is 

A'  =  -Hi  (6.12) 

A/  =  GTxr  (6.13) 

The  first  variation  now  reduces  to 

8 J  =  GpSp  +  £  HJu  +  Hp8p  dr.  (6.14) 

Since  the  variations  8p  are  constant,  they  can  be  removed  from  the  integral 
to  yield 

8J  =  (GP  +  J  Hp  dr)8p  +  jf  Hu8u  dr.  (6.15) 

The  variations  Su  and  8p  are  independent.  If  8u  =  0,  the  first  variation  must 
vanish  because  8p  can  be  either  positive  or  negative.  Therefore,  the  coefficient 
of  Sp  must  vanish,  that  is, 

Gp  +  P  Hp  dr  =  0.  (6.16) 

Jo 

A  similar  argument  can  be  made  for  8u  with  the  additional  assumption  of 
controllability  [4].  Therefore,  the  condition  on  the  control  u  can  be  expressed 
as 

Hu  =  0.  (6.17) 

As  before,  the  quantity  p  is  introduced,  such  that  Eq.  (6.16)  can  be  rewritten 
as  follows 

p'  =  -HJ{t,  X ,  u,  p,  A)  (6.18) 

Po  =  0 

N  =  GTp. 


with  the  boundary  conditions 


(6.19) 

(6.20) 
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To  summarize,  the  first  variation  necessary  conditions  for  a  minimum  are 


H 

II 

(6.21) 

II 

1 

j*! 

jT 

JS 

(6.22) 

H1  =  -Hp(r,x,u,p,  A) 

(6.23) 

Hu  =  0 

(6.24) 

with  the  boundary  conditions 

r0  =  0 

(6.25) 

#0  =  a 

(6.26) 

Po  =  0 

(6.27) 

Tj  =  1 

(6.28) 

0(z/,p)  =  0 

(6.29) 

A/  =  GTXJ{xs,p,v) 

(6.30) 

PJ  =  GTp(xs,p,v). 

(6.31) 

For  a  problem  with  i  states,  j  controls,  k  parameters,  and  l  terminal  con¬ 
straints,  Eqs.  (6.21)-(6.24)  are  2i  +  k  equations.  From  Eqs  (6.29)-(6.31), 
l  i  +  k  final  conditions  are  obtained  which  allow  for  the  solution  of  the  con¬ 
stant  Lagrange  multipliers  v  (/  unknowns),  the  parameters  p,  and  the  final 
state  Xj.  These  equations  can  be  used  to  solve  for  the  remaining  constants 
of  integration.  Since  the  control  does  not  enter  into  the  endpoint  function  G, 
the  condition  in  Eq.  (6.31)  can  be  expressed  as 

ftuif  —  0 

Vtf}  =  °tr 


(6.32) 

(6.33) 
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6.3  The  First  Integral 


The  first  integral  can  be  calculated  quite  readily  by  noting  that 


jrr 

^-  =  Ht  +  Hxx'  +  Huv!  +  Hx\'  +  HpP'. 
dr 


(6.34) 


Since 

=  f,  Hx  =  fT,  A'  =  -Hj,  p'  =  0,  Hu  =  0,  (6.35) 

the  derivative  becomes 

^  =  HT.  (6.36) 

dr 

As  a  result,  if  H  does  not  contain  r  explicitly  (i.e.  Hr  =  0),  the  first  integral 
reduces  to 

H  =  Constant.  (6.37) 


Chapter  7 


Neighboring  Extremal  Paths  for  Problems  with 
Parameterized  and  Nonparameterized  Control 

7.1  Introduction 

In  Chapter  3,  the  neighboring  extremals  have  been  developed  for 
problems  in  which  the  controls  are  parameterized.  In  this  chapter,  neighbor¬ 
ing  extremal  paths  are  developed  for  problems  which  contain  both  parameter¬ 
ized  and  nonparameterized  control.  The  analysis  follows  similar  lines  and  the 
results  are  quite  analogous. 

7.2  Neighboring  Extremals  for  Problems  with  Param¬ 
eterized  and  Nonparameterized  Control 

As  before,  an  extremal  path  which  satisfies  the  first  variation  neces¬ 
sary  conditions  is  assumed.  Throughout  this  development,  the  strengthened 
Legendre-Clebsch  condition  ( Huu  >  0)  is  assumed  to  be  satisfied;  hence,  the 
inverse,  H~*,  exists. 

Suppose  there  exists  a  neighboring  extremal  path  from  a  point  xq ,  = 
xq  +  6xq  at  time  tq  to  a  neighboring  terminal  constraint  manifold  ip*  —  ip  +  Sip. 
Then,  an  admissible  comparison  path  is  formed  by  letting  8xq  and  Sip  go  to 
zero.  If  the  subscript  1  denotes  a  neighboring  extremal  path,  for  this  to  be  an 
admissible  comparison  path  as  well,  the  following  conditions  must  hold: 

Xl  =  /(T,*i,Ui,pi) 

A/  =  -ffJ(T,Xl,Ul,A  !,)>!) 
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(7.1) 

(7.2) 
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0  =  H*(T,xuuu\upi)  (7.3) 

\i\  =  (t,  ®1?  til5  Ai,  pi)  (7.4) 

=  0,  Ai,  =  Gf*/(*i/>Pi,*/i),  A*i,  =  Gjfai/iPi^i)  (7.5) 
a;lo  =  given ,  pi0  =0,  r0  =  0,  T/  =  1.  (7.6) 

Since  a?!  (i)  is  a  neighboring  path  to  x(t), 

xi  =  x  +  8x,  u\  =  u  +  6u,  X\  =  X  +  8X,  Vi  =  v  +  6v,  px=p  +  8p.  (7.7) 

Substituting  these  equations  into  Eqs.  (7.1)-(7.5),  expanding  in  a  Taylor  se¬ 
ries,  and  neglecting  higher  order  terms  (higher  than  one),  the  resulting  equa¬ 
tions  become 


8x'  =  fx8x  -f  fu8u  +  fp8p  (7.8) 

8X'  =  —Hxx8x  —  Hxu8u  —  fj8X  —  Hxp8p  (7.9) 

0  =  Hux8x  +  Huu8u  +  f*8X  +  Hup8p  (7-10) 

8p'  =  —Hpx8x  -  H^u  -  fp8X  -  Hpp8p  (7.11) 

8ip  =  xj>X}8xf  +  x/>p8p  (7.12) 

8Xf  =  GXjX}8xj  +  rj>l}8v  +  GX}P8p  (7-13) 

8pj  =  GpX}8xj  +  ipp8i>  +  Gpp8p.  (7-14) 

where,  as  before,  8xq  =  given  and  8p o  =  given.  In  expressing  Eqs.  (7.9)- 
(7.13),  the  following  relations  have  been  used: 

=  #„*  =  /!,  Gr„  =  tf.  (7.15) 

Eq.  (7.10)  can  be  solved  for  8u  to  yield 

8u  =  - i/-1  (Hux8x  +  fu  8X  +  Hup8p).  (7.16) 
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Substituting  this  equation  into  Eqs.  (7.8)-(7.9)  and  (7.10),  results  in 


8x'  =  ASx  —  B6\  4-  D6p 

(7.17) 

8X'  =  —C8x  —  At8X  —  E8p 

(7.18) 

6p!  =  -ET8x  -  Dt8X  -  F8p 

(7.19) 

where 

A  =  fx  -  fuHu^Hux 

(7.20) 

B  = 

(7.21) 

C  =  Hxx  -  HXUH^HUX 

(7.22) 

D  =  fp  -  fuHZuHuP 

(7.23) 

E  =  Hxp  —  HxuH~]Hup 

(7.24) 

F  =  Hpp  HpuIIuu  Hvp. 

(7.25) 

Eqs.(7.12)-(7.14) 

can  be  expressed  as 

8Xj  =  GxjXf8xj  +  tpl f8v  +  GXjP8p 

(7.26) 

8i)>  =  %}>Xj8xf  +  08  v  +  ipp^P 

(7.27) 

8pf  =  Gpxj6xf  +  tj>p8i/ +  Gpp8p. 

(7.28) 

7.3  Sweep  Method 

As  in  the  previous  section,  the  sweep  method  is  used  to  solve  this 
linear  two-point  boundary- value  problem,  hypothesizing  that  the  solution  is 
of  the  form  of  the  final  conditions,  i.e. 


8X 

—  S(t)8x  +  R(t)8u  +  m(r)<5p 

(7.29) 

8xj) 

=  Rt(t)8x  +  Q(t)6v  +  ti(t)8p 

(7.30) 

8p 

=  mT(T)8x  +  tit(t)8i>  +  a(r)8p 

(7.31) 
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where 


Sf  —  Gxjxj 

(7.32) 

Rf  =  Vxs 

(7.33) 

mj  —  GXjP 

(7.34) 

Qs  =  o 

(7.35) 

«/  = 

(7.36) 

otf  =  Gpp. 

(7.37) 

Differentiating  Eq.  (7.29)  yields 

SX'  =  S'Sx  +  SSx'  +  R'Sv  +  m'Sp.  (7.38) 

Substituting  for  Sx'  and  SX'  from  Eqs.  (7.17)  and  (7.18),  respectively,  yields, 
-  CSx  -  AtS\  -  ESp  =  S'Sx  +  S(ASx  -  BSX  +  DSp)  +  R'Sv  +  m'Sp.  (7.39) 
Substituting  for  SX  from  Eq.  (7.29),  and  collecting  terms  produces 

0  =  (S'  +  C  +  SA  +  AtS  -  SBS)Sx  +  {R!  +  ATR  -  SBR)Su 


+(m'  +  E  +  SD  +  ATm  -  SBm)Sp.  (7.40) 

Since  this  equation  is  valid  for  all  variations  in  x.  v,  and  p,  each  of  the  coeffi¬ 
cients  of  the  variations  must  be  zero,  so  S,  R.  and  m  are  chosen  such  that 

S'  =  SBS -ATS -SA-C,  Sj  =  GX}X}  (7.41) 

R!  =  ( SB-At)R ,  Rf  =  (7-42) 

m'  =  (SB  -AT)m-(SD  +  E),  ms  =  GX]P.  (7.43) 


Notice  that  since  B ,  C,  and  GXfXf  are  all  symmetric,  and  since  the  differential 
equation  for  ST  and  the  boundary  condition  are  the  same  as  for  S,  S  =  ST, 
which  means  that  S  is  symmetric. 
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Similarly,  differentiating  Eq.  (7.30),  with  Sip'  =  0,  gives 

0  =  Rt,Sx  +  RtSx'  +  Q’Sv  +  n'Sp.  (7-44) 

Substituting  for  Sx',  yields 

0  =  Rt'Sx  +  Rt(ASx  -  BSX  +  D6p )  +  Q’Sv  +  n'Sp.  (7.45) 

Accumulating  the  coefficients  of  the  common  variations  produces 

0  =  (Rt'+ Rt A  -  RtBS)Sx +(Q'-  RtBR)Su  +  (n'  -  RT Bm  +  TD)Sp.  (7.46) 

If  R,  Q,  and  m  are  chosen  such  that  the  coefficients  of  the  variations  vanish, 
this  results  in  the  following  set  of  equations  with  the  associated  boundary 
conditions 


R!  =  (SB  —  At)R,  Rj  =  ipl}  (7.47) 

Q'  =  RtBR ,  Q}  =  0  (7.48) 

n'  =  RTBm-RTD,  ns  =  ipp.  (7.49) 

Finally,  differentiating  Eq.  (7.31),  yields, 

Sp!  =  mT'Sx  +  mTSx'  +  nT'Sv  +  a'Sp.  (7.50) 


Substituting  for  Sx'  and  Sp'  from  Eqs.  (7.17)  and  (7.19),  respectively,  yields 

—ETSx—DTS\—F6p  =  mT'Sx+mT(A6x—B6\+D8p)+nT6i>+a'Sp.  (7.51) 

Substituting  for  S\  from  Eq.  (7.29),  and  collecting  terms  produces 

0  =  (mTl  +  ET  +  mT  A  —  mTBS  +  DT  S)Sx  +  ( nTl  +  DT  R  —  mTBR)Si / 

+ (c/  +  F  +  mTD  +  DTm  —  mT  Bm)Sp.  (7.52) 
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This  yields  the  three  equations 

m'  =  (SB  —  AT)m  —  (SD  +  E),  mj  =  GXjP 

n  =  Rt  Bm  —  RtD,  nj  =  x^p 

a'  =  mT  Bm  —  DTm  —  mT  D  —  F,  ay  =  Gpp. 

To  summarize,  the  differential  equations  for  S,  R,  Q,  m 
and  their  respective  boundary  conditions  are 


S' 

=  SBS  -  AtS  -  SA- 

C , 

Sj  = 

R! 

=  ( SB-At)R , 

Rf- 

II 

Q' 

=  rtbr , 

Qi 

=  0 

m! 

=  (SB  -  AT)m  -  (SD 

+  E), 

my 

“  G x jp 

n' 

=  RF Bm  —  RtD, 

ny  : 

a' 

=  rriF  Bm  —  DTm  —  m 

tD  -  F, 

ay 

7.4  The  Neighboring  Extremal  Control 

Eqs.  (7.29)-(7.31)  can  be  written  in  matrix  form  as 


'  8\  ‘ 

’  S(t )  R(t)  m(r ) 

8x 

8x/> 

= 

Rt(t)  Q(t )  n(r) 

8v 

8/i 

mT(r)  nT(r )  a(r) 

8p 

The  last  two  equations  of  the  matrix  can  be  written  in  the  form 

'  6xl>  ‘ 

6fi 

where 


=  Ut6x  +  V 


8v 

6p 


U 


A 


A 


[  R(t)  m(r)  ]  , 

'  Q(t)  n(r) 
tit(t)  a(r) 


(7.53) 

(7.54) 

(7.55) 

,  n,  and  a 

(7.56) 

(7.57) 

(7.58) 

(7.59) 

(7.60) 

(7.61) 


(7.62) 

(7.63) 

(7.64) 

(7.65) 


V 
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Therefore,  if  V -1  exists, 

8v  1  =  -V-'UT'Sx  +  U"1  [  ^  1  (7.66) 

dp  J  [op 

Eq.(7.29)  can  be  rewritten  as 

d\  =  Sdx  +  U  SgVp  .  (7.67) 

Use  of  Eq.  (7.66)  results  in  the  following  equation: 

dX  =  {S  -UV-'U^dx  +  UV-1  **  .  (7.68) 

As  before,  taking  advantage  of  the  symmetry  of  V,  V-1  is  defined  as 

y-1  4  [  “  b  1  (7.69) 

0  c 

where  a  is  of  the  same  dimension  as  Q  (/  X  /),  b  is  of  the  same  dimension  as  n 
(/  x  i b),  and  c  is  the  same  dimension  as  a  (k  x  k ).  In  addition,  S  is  defined  as 

s  =  S  -UV-lUT  (7.70) 

and  8$  is  defined  as 

8$  =  f  1  .  (7.71) 

Ofi 

With  the  definitions  of  V-1  and  U,  the  variations  dv  and  dp  can  be  written  as 

dv  =  —(aRT  +  bmT)dx  +  bdp  +  adip  (7.72) 

dp  —  —(bTRT  +  cmT)dx  +  cdp  +  bTdtl>.  (7.73) 

As  in  the  previous  section,  the  quantities  Rb  +  me  and  Ra  +  mbT  appear 
consistently  and  are  defined  as 

M  i  bTRT  +  cmT  =  [  bT  c\uT 
N  =  aRT  +  bmT  =  [  a  b  ]  UT. 


(7.74) 

(7.75) 
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Therefore,  8v  and  8p  can  be  expressed  as 

8p  =  —M8x  +  c8p  +  bT8x{>  (7.76) 

8v  =  -N8x  +  b8p  +  a8xf>.  (7.77) 

This  result,  along  with  Eqs.  (7.76)  and  (7.68),  is  used  to  express  8u  from  Eq. 
(7.16)  as 

Su  =  -i/;.1  { [H„  +  Sis  -  HupM]  Sx  +  [flMT  +  H„„c\ 

+  [fiN*  +  HppbT]  £V>}  •  (7-78) 

In  addition,  if  the  definitions  of  S,  V-1,  M,  and  N  are  used,  the 
differential  equation  for  8p  can  be  expressed  as  follows 

8p!  =  -  (ET  +  DtS  -  FM )  8x  -  (. DtNt  +  FbT)  8if> 

—  [dt Mt  +  Fcj  8p  (7.79) 

The  differential  equations  for  S,  N ,  M,  a,  b,  and  c  are  derived  in 


Appendix  B. 


Chapter  8 


Sufficient  Conditions  for  Problems  with 
Parameterized  and  Nonparameterized  Control 

8.1  Introduction 

The  sufficient  conditions  for  minima  can  be  used  to  determine  whether 
a  particular  set  of  parameterized  and  nonparameterized  controls,  which  satisfy 
the  first  variation  necessary  conditons,  will  minimize  the  performance  index. 
As  before,  the  second  variation  is  derived  from  the  first  variation.  Then,  the 
sufficient  conditions  are  expressed  in  terms  of  the  Jacobi  (conjugate  point) 
conditions. 

8.2  The  Second  Variation 

Recall  that  the  first  variation  was  expressed  in  Eq.  (2.21)  as 

8J  =  ( GXj  —  X^Sxj  +  Gp8p  +  G„8v  +  \q8xq 

+  / \hx  -  \')8x  +  Hu8u  +  Hp8p  +  (f  -  xt')8\  dr.  (8.1) 
Jo 

The  second  variation  is  obtained  by  taking  the  variation  of  the  first 
variation,  that  is 

82J  =  8xTjGX}Xj8x j  +  8xTjGXjP8p  —  8xj8\j  +  8pTGpX{8xf  (8-2) 
+Aq  82x0  +  8pTGpp8p  +  8ipT8i/  +  (8xTGXfV  +  8pTGpi/)8u 
+<5Ao<5x0  +  A l82x0  +  8vt  ( GVXj8xj  +  Gvp8p ) 
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+8xTHxX8X  +  6xTHxpSp  +  8xT8X'  +  8uTHux8x 
+8ut  Huu8u  +  8ut Hu\8\  +  8uTHup8p  +  8pTHpx8x 
+SpT Hpu8u  +  8pTHp\8\  +  8pT Hpp8p  +  ( fT  —  xT  )82X 
+8XT(fx8x  +  fu8u  +  fp8p  -  8x' )  dr.  (8.3) 

If  the  term  8xT8X'  is  integrated  by  parts  and  Eqs.  (6.21),  (6.22), 
and  (7.15),  as  well  as  the  constraints  are  used  (with  82x o  =  0),  the  second 
variation  is  reduced  to 


82J  = 


G, 

G 


XjXj 


[  8xTj  8p 1 

+  J  |  8xT  8uT  8pT  ] 


GXJP 

8xj 

Gpp  J 

8p 

P^XX 

P XU 

] 

HUx 

Huu 

Hpx 

Hpu 

Hs 

H, 

Hx 


Xp 

up 


8x 

8u 

8p 

dr.  (8.4) 


8.3  The  Perfect  Differential 

Now,  a  perfect  differential  of  the  form, 

P  =  A.[8xTS8x  +  8xTUV-18$  +  8$TV-1UT8x-6<f>TV-18$]  (8.5) 

=  -j-  ^ 8xtS8x  +  8xTMT8p  +  8pT M8x  +  8xT NT '8if> 

-\-8ipT  N8x  —  Sxl>Ta  6^  —  8if>Tb8fi  —  8fiTbT8 rj)  —  8fiTc8fi  j  (8*6) 

along  with  the  condition 

8x  =  fx8x  +  fu8u  +  fp8p  (8.7) 

is  expanded  in  the  following  manner.  If  Eq.  (8.7)  and  the  definitions  of  A-F 
from  Eqs.  (7.20)- (7.25)  are  substituted  into  Eq.  (8.6)  and  factored,  P  becomes 

P  =  8xT(ATS  +  SA  +  HxuH^ftS  +  SfuH^Hux  +  S')8x 
+8uTfiS8x  A  8xTSfu8u  +  8pTfpS8x 


62 


+6xTSfp6P  +  8xt  ( Mt '  +  AtMt 
+HxuH^fuMT)  6(i  +  8uTfuMT6p  +  6(iTMfu6u 
+8(iT  (M'  +  MA  +  MfuH^Hux)  8x 
+6pTfjMT6(i  +  8pTMfp8p  +  8pTfjNT8il> 

+6*l>TNfp6p  +  84>t  (N'  +  NA  +  NfuH^Hux)  6x 

+8uTfT  NT8ip  +  6xl>TNfu8u 

+8xT  (NT'  +  AtNt  +  HxuH~tflNT)  Sip 

—8pTl  [—M8x  +  bT6ip  +  c6pj  —  6ipTa'6ip  —  8ipTb'8p 

—  (—8xTMT  +  8ipTb  +  SpTcj  8p'  —  6pTbT'8tp  —  8pT c'Sp.  (8.8) 

The  quantity  P  is  further  expanded,  by  adding  and  subtracting  cer¬ 
tain  terms,  it  becomes 

P  =  SxT  [ATS  +  SA  +  HxuH^ftS  +  SfuH^Hux  A  S' +  C 
-Hxx  A  -  SBS  -EM-  MTET  +  MTFM 

-SDM  -  MtDtS  -  MTHpuH^flS  +  SfuH^fZ S 
—SfuH~*HupM  -  HxuH^HupM  +  MHpuH^HupM 
—MT HpuH~J:  Hux  A  MtHppM]  6x  A  6ut  (/JS  -  HupM)  6x 
+8xt  (§  fu  —  MTHpu )  8u  A  8ut Hup  [M8x  —  c8p  —  bT 8ip) 

A  ( 8xtMt  —  SpTc  —  8ipTb )  Hpu8u  A  8xTSfp8p  A  8pT fJS8x 
+6pTMfp6p  A  8pTfp  MT6fi  A  8xT  \nt’  -  SBNT  +  ATNT 
+5 flNT  +  SDBt  -  MtDtNt  -  MTFbT  A  EbT 
+SfuH^HupbT  +  HxuH;ZfiNT  A  HxuH~l  HupbT 
-MTHpuH^flNT  -  MTHpuH^HupbT  -  MHppbT]  8 0 
+8xf>T  [iV'  -  NBS  A  fuHZufl  SANA-  NDtS  A  bET 
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+NDM  -  bFM  +  N fuH~*Hux  +  bHpuH^Hux 
+bHpuH^fuS  -  NfuH~*HupM  -  bHpuE~ulHupM 
-bHppMT]  6x  +  6xT  [MTl  +  AtMt  +  HxuH~lflMT  +  Ec 
-SBMt  +  SDc  -  MtDtMt  -  MtFc  +  S fuH~* Mt 
-\-HxuHu*  Hupc  +  SfJlJ  Ilvpc  —  MT  HpuHu^Hupc 
+MTHpuHzlflMT  -  MHppc |  6(i  +  6(iT  [M'  +  MA 
+MfuH^Hux  -  MBS  +  cDtS  -  MDM  -  cFM 
+cEt  +  MfuHzlilS  +  cHpuHzlHux  +  cHpuHzlfTuS 
—cHpuHZu  HupM  -  MfuHZ^HupM  -  cHppM ]  6x 
+6^T  ( bHpu  +  Nfu )  6u  +  SuT  (HupbT  +  fl Nt)  6 V> 

+8pT  ( cHpu  +  MfZ)  6u  +  SuT  (Hupc  +  flMT)  6(i 
+6xl>T  [-b'  -  NBMt  +  NDc  +  bDTMT  +  bFc  +  bHppc 
+bHpu  HZu  f„MT  +  NfuHZ^Hupc  +  NfuHzUlMT 
+bHpuHzjHupc}  6(i  +  6(iT  [—bTl  -  MBNt  +  cDTNT 
+MDbT  +  cFbT  +  cHpuHZufuNT  +  MfuHZ^HupbT 
+MfuHZuflNT  +  cH^HzlB^  +  cHwbT]  8* 

+6^T  [-o'  -  NBNt  +  NDbT  +  bDTNT  +  bFbT 
+bHpuHZufu  NT  +  NfuHzZHupbT  +  N fuHZufu  NT 
+bHpuHZu  HupbT  +  bHppbT]  Sip  +  8(iT  \-c'  -  MBMT 
+MDc  +  cDt  Mt  +  cFc  +  cHppC  +  cHJmHZufI  MT 
+MfuHztHupc  +  M fuHZu  fu  MT  +  cHpuHZ^Hupc]  6(i 
—6pTfp  NT8ip  -  8ipTN  fp8p  -  [6xt  [Hxu  +  Sfu  -  MT Hup) 
+8pT  ( Mfu  +  cHpu)  +  8ipT  ( Nfu  +  bHpu )]  HZ^Hup  • 

•  {—M8x  +  bT8ip  4-  c8p}j  —  (— 6xTMT  +  8^Tb  +  6pTcj  • 
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•HPUHZI  \(HUX  +  fiS-  HupM )  Sx 
+  (/utMt  +  Hupc)  Sp  +  (flNT  +  HupbT )  Sr}] 

-  [SpTl  +  SxT  ( E  +  SD  -  MTF)  +  Sr}?  ( bF  +  ND ) 

+SpT  ( cF  +  MD )]  (-MSx  +  ?Sxji  +  cSp) 

+  SxT  Mt  +  SxpTb  +  6fiTcj  [6?.  +  (et  +  DT S  —  FM)  6x 

+  (F?  +  DtNt )  6xJ>  +  ( Fc  +  DtMt)  Sfi]  (8.9) 

If  certain  terms  in  P  are  recognized  as  the  neighboring  extremal  control  and 
parameters, 


Su  = 


Sp  = 


-tf-1  \{HUX  +  fZS-  HupM )  Sx 

(/JMT  +  Hupc)  Sp  +  [flNT  +  HupbT )  Sxl]  (8.10) 

—MSx  +  cSp  +  ?Sxfi,  (8-11) 


62J  =  [  6xT}  SpT  ' 


and  P  and  the  quantity  (SpT'Sp  +  6pT  Sp]  are  added  to  and  subtracted  from 
the  second  variation  defined  in  Eq.(8.4),  S2J  becomes, 

Q  X  fX  f  Gxjp  1  I"  Sx j  1 

L  GpX}  Gpp  \  [  Sp  \ 

+SxT  [S’  +  AtS  +  SA  +  C-  SBS  -EM-  MTET  +  MTFM 
-SDM  -  MtDtS ]  Sx  +  SxT  [NT'  -  SBNt 
+AtNt  +  SD?  -  MtDtNt  -  MTFbT  +  EbT ]  6xj> 

+6xp  [iV'  -  NBS  +  NA  +  bDTS  -  NDM  -  bFM  +  bET\  Sx 
+SxT  [mTi  +  AtMt  -  SBMt  +  SDc  -  MtDtMt  -  MTFc  +  Ec]  Sp 
+6pT  [. M '  +  MA-  MBS  +  cDtS  -  MDM  -  cFM 
+cEt ]  Sx  -  Sxl?  [a7  +  NBNt  -  ND?  -  bDTNT  -  bF? ]  Sxf> 
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-SxjF  [ b f  +  NBMt  -  NDc  -  bDTMT  -  bFc ]  8p 
-8(iT  [ bTl  +  MBNt  -  MDbT  -  cDtNt  -  cFbT ]  8 ip 
-SpT  [c'  +  MBMt  -  MDc  -  cDtMt  -  cFc ]  8p 
+  [8ht>  +  8xT  (. E  +  SD  -  MTF) 

+8ij>T  ( bF  +  ND)  +  8nT  ( cF  +  MD)\  ( 8p  -  8p) 

+  ( 6pT  -  8pT )  [8fi'.  +  (ET  +  DtS  -  FM )  8x 

+  (. FbT  +  DtNt)  8ij>  +  (Fc  +  DtMt)  V] }  dr.  (8.12) 

Now,  S ,  Af,  N,  a,  b,  c,  and  8p  are  chosen  to  satisfy  the  following  relations, 
similar  to  the  reasoning  in  Bryson  and  Ho[4], 


S'  =  SBS  -AtS  -SA-C  +  EM  +  MtEt 

-MtFM  +  SDM  +  MtDtS  (8.13) 

M'  =  MBS  -MA-cDtS  +  MDtMt  +  cFMt  -  cEt  (8.14) 

N'  =  NBS  -NA-bDTS  +  NDTMT  +  bFMT  -bET  (8.15) 

a'  =  -NBNt  +  NDbT  +  bDTNT  +  bFbT  (8.16) 

b'  =  —NBMt  +  NDc  +  bDTMT  +  bFc  (8.17) 

c'  =  -MBMt  +  MDc  +  cDtMt  +  cFc  (8.18) 

8p'  =  -  (Et  +  DtS  -  FM)  8x 

-  (FbT  +  DtNt )  8$  -  (Fc  +  DtMt)  8p  (8.19) 


(8.20) 

(8.21) 

(8.22) 
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8ps  =  Gpx/6xj  +  i%8v  +  Gpp8p,  (8.23) 

where  the  bar  over  p  and  v  denotes  those  quantities  correspond  to  the  neigh¬ 
boring  extremal  trajectory. 

The  second  variation  now  becomes 


82J 


l  1  [  g:;;  g’:  ]  [  h 

+  J  |  [  (8uT  —  8uTJ  (6pT  —  8pT^j 


H uu  Hup 

Hpu  Hpp 


( 8u  —  8u ) 
(8p  -  6p) 


—8pT8p'  —  8pT> 8p  —  -jj-  [6arr5,6x 


dr 


+8xTUV~16$  +  8$TV~lUT8x  -  6$]}  dr. 


(8.24) 


The  second,  third,  and  fourth  terms  can  be  integrated  directly;  therefore,  the 
second  variation  is  further  reduced  to 


82J  =  |  8xTj  8pT  j 


G. 


XfXf  ^xfp 

Gpxf  Gpp 


8xj 

8p 


-  [8pT8p  +  8pT8p]1Q  -  [, 5xTS8x  +  8xTUV~18^ 

+8$Tv-1uT6x  -  s^v-1 £$]* 

4-  J  |  (8uT  —  8uT^j  (8pT  —  8pT )  j 


'  Huu 

HUp' 

(8u  —  8u ) 

HpU 

HPP . 

(8p  -  8p) 

dr. 


(8.25) 


The  terms  outside  the  integral  are  separated  into  those  at  the  initial 
time  and  those  at  the  final  time  as  follows: 


82J  =  Y0  +  Yj  +  £[  (8ut  -  8uT )  (8pT  -  8pT)  ] 

■  8u) 

8p) 


'  Huu  Hup  1  f  (6u  -  8u) 

Hpu  Hpp  J  [  (  8p 


dr 


(8.26) 


where  Y0  and  Yj  are  defined  by 


8pT8p0  +  8pT08p  +  8xT0S08x0  +  8x0 U0Va  8$ 
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+6**Ve-1U?6x0  -  69*Ve-H*0  (8.27) 

Yf  =  6xjGXfXJ6xf  +  6x]GXfPSp  +  8pTGpX}8xj  +  6prGpp8p 

—8pT8p  f  —  8pTj8p  —  8xTjS;8xj  —  6x'fUfVj~16$f 

-StfVf'Uj  8x}  +  StfVf'SQf.  (8.28) 


After  substituting  for  pj,  Sj,  UjVj  \  and  V}  \  Eq.  (8.28)  is  rewritten  as 

Yj  =  8pTGpp8p  -  8pT  [ipp8u  +  Gpp8p\  -  \SvTipp  +  8pGpp\  8p 

( 

1 


-\-8xTf 


GXfP 


0  Ip, 

V,  Gpp 


1-1  r 


& 

G, 


8x4 


T  n 

Xj  ^XfP 


-8xt}  [  ip: 

-\(<pt  </*nr° 

+  [  8ipT  8pTf  ] 


1 

o  ipP 

-1 

Sip 

J 

1 - 

*»S 

Sfif 

V’p 

H  Gw 


0 

€  G. 


F 

PP 


-l  r 


-i  r 


i’xj 
Gpxf  j 

6$ 
8pf 


8x  / 


(8.29) 


Recall  that  on  the  neighboring  extremal  path,  Eq.  (7.63)  evaluated  at  the 
final  time  is  expressed  as 


Ip: 

G. 


XJ 


px,  J 


8xf  =  — 


0  ipp 

€  G, 


PP 


II 


8v 

8p 


+ 


Sip 

8pf 


(8.30) 


Eq.  (8.30)  is  used  to  reduce  Eq.(8.29)  to 

Yf  =  8pTGpp8p  -  8pTGpp8p  -  8pTGpp8p  -  8pTx^8u  -  8i>Tipp8p 


+  j-  [  8vT  8pT  ] 

(-( 

-{-[«? 


0 


%  Gpp 


+ 


o  ipP 
Vp  Gpp 


Vp  G. 


PP 


8pT 
-l  r 


8v 

8p 

0 


+ 


Sip 

8pf 


I. 

]) 


8ipT 

8p?f 


]}[•« 


^p 


G. 


PP 


-1 


L#  G„ 


8ipT 


V/]} 

- 1 H  ‘h  1  f  It  g„ 


-1 
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0  V>P 
V’p  GVP 


8v 

8p 


+ 


1>i  Gt 


6i/> 

hs 

-1 


) 


6V 

hs 


(-[ 

+[<v>r  </-nro 

which  further  simplifies  to 

=  8pTGpp8p  -  8pTGpP6p  -  8pTGpp8p  -  8pTipp8v 
-SvTi,pSP+  [  Si?  Sf  ]  Jj.  |  ] 


(8.31) 


(8.32) 


Yj  now  reduces  to 

Yf  =  ( 8p-8p)TGpp{8p-8p)-(8p-8p)Ttf8D 

—8uTxpp  ( 8p  —  8p) .  (8.33) 

At  the  terminal  constraint  manifold,  the  neighboring  extremal  and  the  admis¬ 
sible  comparison  path,  respectively,  must  satisfy  the  following  equations 

0  =  tl>Xf8xf  +  xj)p8p  (8.34) 

0  =  il>Xf8x}  +  ippSp,  (8.35) 

Therefore,  if  these  two  equations  are  subtracted,  the  resulting  equation  is 

tpp  (8p  —  8p)  =  0  (8.36) 

With  this  relation,  Yj  can  be  finally  reduced  to 

Y,  =  (Sp-6pf  G„(Sp-6p).  (8.37) 


Y0,  from  Eq.  (8.27),  can  also  be  written  as 
Y0  =  8pT8p0  +  8p°8p  +  8xt0S8xo  +  8xT0U0V~l8§ 

+8$tV0-1U*8x0  -  S^V-'SQ  (8.38) 

=  8pT8p0  +  8p^8p  +  8x^S8x0  +  8xT0Nj8^ 

8ij>TN08x0  +  8x^ Mj 8 p0  +  8plM08x0  -  8ipTa08ip 
—8p1b08ip  —  6^Tbl8p0  —  8p1c08p0 


(8.39) 
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Since  Sfio  =  0  and  Sip  =  0,  Y0  becomes 

Y0  =  Sx^SoSxo 

Therefore,  the  second  variation  in  Eq.  (8.26)  becomes 

82J  =  6xlS06x0  +  (6p  —  Sp)T  GpP(8p  -  tip) 
+  J'[(Sut-6ut)  (S^-Sf)} 
f  Huu  Hup  1  [  (Su  -  8u )  1 

[hpu  HPp  J  [(Sp-Sp)  J  aT- 


(8.40) 


(8.41) 


For  an  admissible  comparison  path,  that  is  one  which  lies  in  the 
neighborhood  of  the  extremal  and  which  satisfies  all  the  constraints,  8x0  =  0, 
8$  =  0,  and  8fi0  =  0.  Therefore,  if  S0  and  U0V~l  are  finite  over  [0, 1),  the 
initial  point  term  outside  the  integral  in  Eq.  (8.29)  vanishes  and  the  second 
variation  reduces  to 


82  J  —  ( Sp  -  Sp)T  Gpp  ( 8p  ~f>P)  +  J0  [  ~  6uT) 

HUn  Hup  1  [  {8u  -  8u)  1 

Hpu  HpP  j  (8p  -  8p)  J  aT- 


(8pT  -  8pT )  ] 

(8.42) 


Hence,  if  Eq.  (8.42)  is  positive  definite,  the  second  variation  is  positive  for 
arbitrary  variations  8p  and  6u ,  unless  8p  =  8p  and  8u  =  8u.  This  can  occur 
only  if  the  admissible  comparison  path  is  a  neighboring  extremal.  However, 
Eq.  (3.69)  indicates  that  for  S0  and  U0V~l  finite  and  8x0  =  0,  8p  =  0,  and 
8tp  =  0,  this  results  in  £A0  =  0.  With  this,  Eq.  (3.77)  reduces  to  8p  —  0  and 
8u  =  0.  Therefore,  Eqs.  (3.16)  -  (3.18)  simplify  to  8x  =  8X  =  6p  =  0,  which 
implies  that  8p  =  0,  or  that  there  is  no  admissible  comparison  path  which  is 
a  neighboring  extremal  path.  Therefore,  the  extremal  path  is  a  minimum. 


On  the  other  hand,  if  SQ  and  U0V0  1  become  infinite,  8xa  =  0 ,8p  =  0, 
and  8ip  =  0  could  lead  to  a  finite  8X0  and  to  an  admissible  comparison  path 
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which  is  a  neighboring  extremal.  Therefore,  the  second  variation  could  become 
negative  and  the  extremal  path  is  not  a  minimum.  This  is  also  the  case  when  S 
and  UV~l  become  infinite  at  some  point  within  the  interval.  If  this  happens, 
this  point  is  called  a  conjugate  point. 

The  sufficient  conditions  are  formulated  from  the  operations  needed 
to  form  S2J  as  a  perfect  square.  In  addition,  since  a  perfect  differential  is 
added  to  the  second  variation,  S ,  UV~l,  and  V-1  must  be  finite  for  a  finite  Sx 
and  6$  to  lead  to  a  finite  8v  and  8p,  as  well  as  to  a  finite  8X.  These  conditions 
can  also  be  stated  as  requiring  the  derivatives  of  S,  UV~l ,  and  V~1  to  be 
integrable  over  [0,1)  or  as  S ,  UV*1,  and  V-1  to  be  finite  over  [0,1).  The 
following  theorem  states  the  sufficient  conditions. 


Theorem  2  If  the  first  variation  necessary  conditions  for  a  minimum  are 
satisfied  and  the  following  conditions  are  satisfied, 


1)  Huu  >  0, 

6»  Huu  HUp  « 

A)  TT  p  _|_  ZJ  ^  U) 

-L-L  pu  ^  pp  T  ~Hpp 

3)  S  finite  over  0  <  r  <  1, 

4)  UV~X  finite  over  0  <  r  <  1,  and 

5)  V-1  finite  over  0  <  r  <  1, 


then  this  solution  is  a  minimum. 


Chapter  9 


Conclusion 


Sufficient  conditions  for  optimal  control  problems  with  parameter¬ 
ized  controls  are  developed.  These  conditions  have  been  applied  to  a  fairly 
realistic  missile  intercept  problem. 

In  Chapter  2,  the  first  variation  necessary  conditions  for  optimal 
control  problems  with  parameters  are  developed.  The  quantity  //,  whose  dif¬ 
ferential  equation  has  the  same  form  as  the  differential  equation  for  A,  is 
introduced. 

In  Chapter  3,  the  theory  associated  with  neighboring  extremal  tra¬ 
jectories  is  developed.  This  is  done  using  the  sweep  method.  Variations  of  the 
first  variation  necessary  conditions  are  taken  and  this  results  in  a  set  of  Riccati 
equations  which  govern  the  behavior  of  these  trajectories.  The  neighboring 
extremal  parameterized  control  law  is  also  developed. 

In  Chapter  4,  the  sufficient  conditions  for  a  minimum  for  parame¬ 
terized  control  are  derived.  First,  the  second  variation  is  obtained  by  taking 
the  variation  of  the  first  variation.  The  key  to  the  sufficient  conditions  is 
the  addition  of  a  particular  perfect  differential  to  the  second  variation.  This 
reduces  the  second  variation  to  a  perfect  square  involving  the  same  form  as 
the  neighboring  extremal  parameters  obtained  in  Chapter  3.  The  other  terms 
are  solely  functions  of  quantities  at  the  initial  time.  Using  these  results,  the 
sufficient  conditions  for  a  minimum  are  formulated. 
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In  Chapter  5,  the  sufficient  conditions  are  applied  to  a  missile  inter¬ 
cept  problem  whose  model  is  an  EMRAAT  class  missile,  with  a  single  thrust 
phase.  Optimal  trajectories  are  generated  for  two  realistic  missile  engagement 
scenarios,  the  first  one  involving  a  target  moving  toward  the  launching  aircraft 
at  1,000  ft/sec  at  an  initial  range  of  40  miles,  and  the  second  involving  a  target 
moving  away  from  the  launching  aircraft  at  1,000  ft /sec  at  an  initial  range  of 
30  miles.  The  characteristics  of  these  optimal  trajectories  are  presented.  The 
sufficient  conditions  for  a  minimum  are  applied  to  both  these  cases  and  are 
satisfied. 

In  Chapter  6,  the  first  variation  necessary  conditions  are  obtained  for 
the  case  where  there  are  both  parameterized  and  nonparameterized  controls. 
The  first  integral  is  also  obtained. 

Chapter  7  contains  the  development  of  the  neighboring  extremal  tra¬ 
jectories  for  the  class  of  problems  where  there  are  both  parameterized  and  non¬ 
parameterized  controls.  In  addition,  the  neighboring  extremal  parameterized 
and  nonparameterized  control  laws  are  obtained. 

In  Chapter  8,  the  second  variation  condition  is  obtained  for  the  case 
where  there  are  both  parameterized  and  non-parameterized  controls.  The 
development  closely  follows  that  in  Chapter  4,  and  the  conditions  obtained 
are  analogous  to  those  obtained  in  Chapter  4. 

Further  Work 

While  the  sufficient  conditions,  which  are  derived,  are  quite  general 
and  encompass  a  large  class  of  deterministic  optimal  control  problems,  they 
need  to  be  applied  to  a  wider  variety  of  problems  to  gain  experience  with  the 
application  of  these  conditions  and  investigate  the  behavior  of  these  new  Ric- 
cati  equations.  In  a  similar  vein,  a  ‘feedback’  control  law  for  parameterized 
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control  needs  to  be  analyzed  for  neighboring  extremal  guidance  type  applica¬ 
tions. 


Appendix  A 


Derivation  of  the  Differential  Equations  for  5,  V  1 , 
and  UV~l  for  Parameterized  Control 


In  this  Appendix,  the  differential  equations  for  the  components  of  S, 
V-1,  and  UV*1  are  derived.  First,  recall  that  V  and  V -1  have  been  defined 
to  be 


V  ± 


y-i  4 


0  n(r) 
nT(r)  Q!(t)  J 

a  b 
bT  c 


The  differential  equation  for  V ,  using  Eqs.  (3.62)-(3.61),  is 
V'  =  - 


0  RTD 

DTR  mTD  +  DTm  +  F 


With  this  equation,  the  differential  equation  for  V  1  is  expressed  as 


r-v 


v -1 


0  RTD 

DTR  mTD  +  DTm  +  F 


V 


-l 


However,  the  quantity  UV -1  is  expressed  as  follows 
UV~X  =  |  Ra  +  mbT  Rb  +  me  j  =  |  NT  MT  ] . 
Using  this  equation  along  with  Eq.  (A.2),  Eq.  (A.4)  is  expressed  as 


V-v  = 


(aRT  +  bmT)DbT  +  bDT(Ra  +  mbT )  +  bFbT 
( bTRT  +  cmT)DbT  +  cDT(Ra  +  mbT )  +  cFbT 

bDT(Rb  +  me)  +  ( aRT  +  bmT)Dc  +  bFc 
(bT  RT  +  cmr)Dc  +  cDT(Rb  +  me)  +  cFc 


(A.l) 

(A.2) 


(A.3) 


(A.4) 


(A.5) 


(A.6) 
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which  further  reduces  to 


v  \  NDbT  +  bDTNT  +  bFbT 

V  ~  [  MDbT  +  cDTNT  +  cFbT 

bDTMT  +  NDc  +  bFc 

(A.7) 

MDc  +  cbTMT  +  cFc 

The  differential  equations  for  a,  6,  and  c  are  expressed  as 

a'  =  NDbT  +  bDTNT  +  bFbT 

(A.8) 

b'  =  bDTMT  +  NDc  +  bFc 

(A.9) 

c'  =  MDc  +  cDtMt  +  cFc 

(A.10) 

or  alternatively  as 

a'  =  (aRT +  bmT)DbT +  bbT(Ra  +  mbT)  +  bFbT 

(A.11) 

b'  =  b£)T(Rb  +  me)  +  ( aRT  +  bmT)Dc 

+  bFc 

(A.12) 

c'  —  (bT  Rt  +  cmT)Dc  +  cDT(Rb  +  me)  +  cFc. 

(A.13) 

Recall  that  U  was  defined  to  be 

U=[R  m] 

(A.14) 

and  upon  differentiating  and  using  Eqs.  (3.58)  and  (3.59)  becomes 

U'  =  [  -ATR  -ATm  ~{E  +  SD)  ] 

(A. 15) 

which  reduces  to 

U'  =  -ATU  -  [  0  (E  +  SD)  ] 

• 

(A. 16) 

The  differential  equation  for  S  is  obtained  using  the  quantities  derived  above. 
Recall  that  S  is  defined  as 
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Differentiating  this  yields 

S'  =  S'  -  U'V~XU T  -  UV~vUT  -  UV~1UT'.  (A. 18) 

After  certain  substitutions  from  Eqs.  (3.57),  (A. 16),  and  (A.7)  are  made,  this 
becomes 

S'  =  -AtS-SA-C 

+AtUV~1Ut  +  [  0  (E  +  SD)  ]  V~yUT  (A. 19) 

f  NDbT  +  bf)TNT  +  bFbT 
U  [  MDbT  +  cDTNT  +  cFbT 

bDTMT  +  NDc  +  bFc  1  T 
MDc  +  cDT  MT  +  cFc 

+UV-1UTA  +  UV~ 1  °(ET  +  £)TS)  ■  (A-2°) 

The  quantity  UV^U^  is  also  expressed  as 

f/V_1{yT  =  f  NT  Mt  1  RTt  =  NtRt  +  MTmT  =  RN  +  mM.  (A.21) 
L  -I  m 

If  Eqs.  (A.21)  are  used  and  terms  involving  S  are  factored,  the  equation 
further  reduces  to 

S'  =  -At(S  -UV~lUT)-{S  -UV~xUt)A-C 

+E(bTRT  +  cmT)  +  (Rb  +  mc)ET  -  (Rb  +  mc)F(bTRT  +  cmT) 
+(5  -  UV~1Ut)DM  -  MtDt(S  -  UV-'U7).  (A.22) 

This  equation  further  simplifies  to 

S'  =  -ATS  -SA  +  EM  +  MtEt 

AS  DM  +  MtDtS  -  C  -  MtFM. 


(A.23) 
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Using  similar  reasoning,  the  differential  equations  for  M  and  N  is 
derived  as  follows 


dUV^_ 

dr 


J'V -1  +  UV~v 

- ATUV~ 1  -  [  0  (E  +  SD)  ]  V-1 

\  NDbT  +  bDTNT  +  bFbT 
VU  [  MDbT  +  cbTNT  +  cFbT 

tbT  Mt  +  NDc  +  bFc 


(A.24) 


(A.25) 


Using  the  definition  of  UV _1  from  Eq.  (A. 5)  and  the  definition  of 
V1  from  Eq.  (A. 2)  and  factoring,  the  differential  equations  for  M  and  N  is 
expressed  as 


Nt>  =  -AtNt  -  SDbT  -  EbT  +  MtDtNt  +  MTFbT  (A.26) 

N'  =  —NA  -  bDTS  -  bET  +  NDM  +  bFM  (A.27) 

Mt>  =  -AtMt  -  SDc  +  MtDtMt  +  MtFc  -  Ec  (A.28) 

M'  =  —MA  —  cDTS  —  cEt  +  MDM  +  cFM.  (A.29) 

(A.30) 

In  summary,  the  differential  equations  for  S,  M,  Ar,  a,  b,  and  c  are  as  follows 


S'  =  -AtS-SA+EM  +  MtEt 

+SDM  +  MtDtS  -  C  -  MtFM  (A.31) 

M'  =  -MA-cDtS  -cEt  +  MDM  +  cFM  (A.32) 

N'  =  —NA  —  b£)TS  —  bET  +  NDM  +  bFM  (A.33) 

o'  =  NDbT  +  bDTNT  +  bFbT  (A.34) 

b'  =  NDc  +  bDT  Mt  +  bFc  (A.35) 

c'  =  MDc  +  cDt  Mt  +  cFc.  (A.36) 


Appendix  B 


Derivation  of  the  Differential  Equations  for  5,  V-1, 
and  UV~l  for  Parameterized  and  Nonparameterized 

Control 


In  this  Appendix,  the  differential  equations  for  the  components  of  S, 
V~\  and  UV~X  are  derived.  First,  recall  that  V  and  V*1  have  been  defined 
to  be 


V  ± 


V-1 


A 


Q(t)  n(r) 
nT(r)  a(r) 

a  b 
bT  c  • 


The  differential  equation  for  V ,  using  Eqs.(3.62)-(3.61),  is 


RtBR  RTBm  -  RTD 

mTBR  —  DTR  mT Bm  —  mT D  —  DTm  —  F 


(B.l) 

(B.2) 


(B.3) 


which  is  expressed  more  in  a  more  compact  form,  using  Eq.  (3.65),  as 


V  =  utbu  - 


0  RTD 

DTR  mTD  +  DTm  +  F 


(B.4) 


With  this  equation,  the  differential  equation  for  V  1  is  expressed  as 


V~v  =  -V~xUtBUV-x  +  V 


-1  I  T/-1 


0 


RTD 


DTR  mTD  +  DTm  +  F 


V 


-l 


(B.5) 


However,  the  quantity  UV  1  is  expressed  as  follows 

UV~X  —  [  Ra  +  mbT  Rb  +  me  j  =  J  NT  MT  j .  (B-b) 
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If  this  equation,  along  with  Eq.(B.2),  is  used,  Eq.  (B.5)  is  expressed  as 


V~v 


nbnt  nbmt 
mbnt  mbmt 


+ 


(aRT  +  bmT)DbT  +  bDT(Ra  +  mbT)  +  bFbT 
(bT  Rt  +  cmT)DbT  +  cDT(Ra  +  mbT )  +  cFbT 


bDT(Rb  +  me)  +  (aRT  +  bmT)Dc  +  bFc 
( bTRT  +  cmT)Dc  +  cDT(Rb  +  me)  +  cFc 


(B.7) 


which  further  reduces  to 


‘  -NBNT  +  NDbT  +  bDTNT  +  bFbT 
-MBNT  +  MDbT  +  cDtNt  +  cFbT 

-NBMt  +  bDTMT  +  NDc  +  bFc  ' 
-MBMT  +  MDc  +  cDtMt  +  cFc  ' 


The  differential  equations  for  a,  b ,  and  c  are  expressed  as 


a!  =  -NBNt  +  NDbT  +  bDTNT  +  bFbT 

(B.9) 

b'  =  -NBMT  +  NDc  +  bDTMT  +  bFc 

(B.10) 

c'  =  -MBMt  +  MDc  +  cDtMt  +  cFc 

(B.ll) 

or  alternatively 

as 

o!  = 

— ( aRT  +  bmT)B(Ra  +  mbT )  +  ( aRT  +  bmT)DbT 

+bDT(Ra  +  mbT)  +  bFbT 

(B-12) 

b'  = 

— ( aRT  +  bmT)B(Rb  +  me)  +  bDT(Rb  +  me) 

+(aRT  +  bmT)Dc  +  bFc 

(B.13) 

d  = 

— ( bTRT  +  cmT)B(Rb  +  me)  +  (bT  RT  +  cmT)Dc 

(B.14) 

+cDT(Rb  +  me)  +  cFc. 


Recall  that  U  was  defined  as 


U  =  [  R  m  ] 


(B.15) 
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and  upon  differentiating  and  using  Eqs.  (3.58)  and  (3.59)  becomes 

U'  =[(££-  AT)R  (SB  -  AT)m  ~(E  +  SD)  ]  (B.16) 

which  reduces  to 

U'  =  (SB  -  At)U  -  [  0  (E  +  SD)  ] .  (B.17) 

The  differential  equation  for  S  is  obtained  using  the  quantities  derived  above. 
Recall  that  S  is  defined  as 

S  =  S-  UV-'U T.  (B.18) 

Differentiating  Eq.  (B.18)  yields 

S'  =  S'  -  U'V~XUT  -  UV-vUT  -  UV~1UT'.  (B.19) 

If  Eqs. (3.57),  (B.17),  and  (B.8)  are  used,  this  becomes 

S'  =  SBS -ATS -SA-C 

-(SB  -  At)UV~xUt  +  [  0  (E  +  SD)  ]  V~XUT  (B.20) 

f  —NBNT  +  NDbT  +  bDTNT  +  bFbT 
U  [  -MBNt  +  MDbT  +  cDTNT  +  cFbT 

-NBMt  +  bDTMT  +  NDc  +  bFc  1  T 
-MBMT  +  MDc  +  cDTMT  +  cFc  \ 

-UV~1Ut(BS-A)  +  UV~1  °{et  +  dts)  •  (B.21) 

The  quantity  UV~lUT  is  expressed  as 

UV~lUT  =  [  NT  M  ]  =  NtRt  +  MTmT  =  RN  +  mM.  (B.22) 

If  Eqs.  (B.22)  are  used  and  terms  involving  S  are  factored,  the  equation  is 
further  reduced  to 


S'  =  (, S  -UV~1UT)B(S  -UV~1UT)-AT(S  -UV-XUT ) 
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-(S  -  UV~1Ut)A -CA  E{bTRT  A  cmT )  +  ( Rb  A  mc)ET 
-(Rb  +  mc)F(bTRT  +  cmT)  A  (S  -  UV^U^DM 
-MTDT(S  -  UV-'U T).  (B.23) 


This  equation  further  simplifies  to 


S'  =  SBS  -AtS  -SA  +  EM  +  mtet 
AS  DM  +  MtDtS  -  MtFM  -  C. 


(B.24) 


Using  similar  reasoning,  the  differential  equations  for  M  and  N  is 
derived  as  follows 


dUV^_ 

dr 


U'V~l  +  UV~v 


{SB  -  At)UV~1  -  [  0  {E  A  SD)  ]  U"1 


AU 


-NBNT  A  NDbT  A  bDTNT  +  bFbT 
-MBNT  A  MDbT  A  cDTNT  A  cFbT 


-NBMT  A  bDTMT  A  NDc  A  bFc 
-MBMT  +  MDc  A  cDtMt  A  cFc 


(B.25) 


(B.26) 


If  the  definition  of  UV~l  from  Eq.  (B.6)  and  the  definition  of  V~l 
from  Eq.  (B.2)  is  used  and  Eq.  (B.26)  is  factored,  the  differential  equations 
for  M  and  N  are  expressed  as 


Nt’  =  (SB  -  At)Nt  -  SDbT  -  EbT  +  MtDtNt  A  MTFbT  (B.27) 
N'  =  N(BS-A)-bDTS-bET  ANDMAbFM  (B.28) 

MTi  =  ( SB-At)Mt-SDcAMtDtMtAMtFc-Ec  (B.29) 
M'  =  M(BS  -A)-cDtS  -cEt  AMDMAcFM.  (B.30) 


In  summary,  the  differential  equations  for  5,  M,  N,  a,  b ,  and  c  are  as  follows 
S'  =  SBS  -  AtS  -SAA  EM  A  MT  Et 
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+SDM  +  MtDtS  -  MtFM  -  C  (B.31) 

M'  =  M(BS-A)-cDtS-cEt  +  MDM  +  cFM  (B.32) 
N'  =  N(BS  -  A)  -  bDTS  -  bEr  +  NDM  +  bFM  (B.33) 

a'  =  -NBNt  A  NDbT  +  bDTNT  +  bFbT  (B.34) 

b'  =  -NBMT  +  NDc  +  bDTMT  +  bFc  (B.35) 

c'  =  -MBMt  +  MDc  +  cDtMt  +  cFc.  (B.36) 


Appendix  C 


The  Parameterized  Shooting  Algorithm 

C.l  Introduction 

The  parameterized  shooting  method  is  a  technique  which  solves  the 
linear  two  point  boundary  value  problem  when  the  control  is  parameterized. 
In  general,  the  final  time,  when  it  is  unknown,  is  included  as  part  of  the 
parameters.  This  particular  algorithm  uses  the  transition  matrix  approach  to 
solve  for  the  parameters.  As  in  the  regular  shooting  method,  it  requires  the 
guesses  of  the  Lagrange  multipliers  at  the  initial  time  as  well  as  the  guesses 
of  the  parameters. 

C.2  The  Pertinent  Equations 

The  equations  of  interest  are  the  first  variation  necessary  conditions 


obtained  in  Section  2.2.  They  are  as  follows 

x'  =  f(T,X,Ui,tf)  (C.l) 

A'  =  -tfJ(r,x,ut-,t/,A)  (C.2) 

/*«/  =  A)  (C.3) 

fttj  =  Htf(T,x,Ui,tj,\)  (C.4) 

with  the  boundary  conditions 

il>(xf,tf)  =  0  (C.5) 

K,  =  GTXf  (C.6) 
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^Uif  —  0 

^!S  =  G*r 


(C.7) 

(C.8) 


If  the  vector  z  is  defined  as  follows 


z  = 


X 

X 

Vu, 

L  »t,  J 


Eqs.(C.l)-(C.4)  become 


z'  =  F(t,z, 


where 


F(T,Z,Ui,tf)  = 


f(r,  2,  Ui,tf) 
-Hj{T,Z,Ui,tf) 

-Htf(T,Z,Ui,tf) 


Taking  the  variation  of  Eq.  (C.10)  yields 


(0.9) 


(C.10) 


(C.ll) 


Sz'  =  Fz6z  +  FUiSui  +  Ftj6tf. 


(C.12) 


A  solution  of  Eq.(C.12)  of  the  following  form  is  assumed 

Sz  =  $8zq  +  (Sui  +  KStf,  (C.13) 

which  upon  differentiation  becomes 

Sz'  =  &6z0  +  ('Sui  +  K'Stj.  (C.14) 

If  Eq.  (C.13)  is  substituted  for  Sz  into  Eq.  (C.12),  it  results  in 

Sz'  =  Fz$Sz0  +  (Fz(  +  FUi)SUi  +  (FZK  +  Ftf )  Stf.  (C.15) 
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When  Eqs  (C.14)  and  (C.15)  are  equated,  the  following  differential  equations 
for  $,  and  K  are  obtained 


$' 

II 

& 

II 

O 

& 

(C.16) 

C' 

—  Fz(  +  FUi-, 

o 

II 

<3 

(0.17) 

K ' 

=  FZK  +  Ft}; 

O* 

II 

p 

(C.18) 

As  stated  in  Eq.  (C.16),  the  state  transition  matrix  behaves  accord¬ 
ing  to  the  following  relation 


$(t,To)'  =  E*$(t,t0) 


where  Fz  is  expressed  as 


Fz  = 


/. 


H. 


XX 

T 


(fe) » . 


-Ht 


0 

-Hx  A 
-Ht 


ltfX  ~lltf  * 

The  state  transition  matrix  reduces  to  the  following 

$11  0  0  0 

$21  $22  0  0 


$(r,  r0)  = 


$31 
L  $41 

where  the  individual  sub-matrices  of  $  can  be  obtained  from 


0 

$22 
$32  I  0 
$42  0  I 


0  0 
0  0 

0  0 
0  0 


(0.19) 


(C.20) 


(0.21) 


*-*  *s“ 

II 

> 

t— i 

*llo  =  I 

(C.22) 

$21  —  HXXQ  11  T  Hx  A  $2l! 

$210  =  0 

(C.23) 

$22  =  ~HX  A$22i 

$220  =  I 

(C.24) 

*”  =  ~  (thi)  ~  (a^) 

o 

II 

o 

rH 

CO 

& 

(C.25) 

w 

to 

o 

II 

o 

(C.26) 

$41  =  —Htfx$  11  H - Ht}\$  21) 

$410  =  0 

(C.27) 

$42  :=  —Htf  A$22i 

& 

to 

o 

II 

p 

(C.28) 
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It  turns  out  that  the  only  components  of  the  state  transition  matrix  which  are 
needed  are  $22  >  $32 ,  and  $42. 

For  a  problem  with  i  states,  j  controls,  k  parameters,  and  /  con¬ 
straints,  h,  which  contains  the  conditions  at  the  final  time  which  need  to 
satisfied,  is  of  dimension  i  +  k.  At  the  initial  time,  there  are  i  +  k  quantities 
which  are  known;  only  A0  is  unknown.  At  the  terminal  time,  there  are  l  +  i  +  k 
final  conditions.  Of  these,  l  equations  are  solved  for  the  l  Lagrange  multipliers 
1/,  which  are  then  eliminated  from  the  remaining  conditions  to  yield  the  vector 
h  which  can  be  written  as 

h(zf,U{,tf)=0.  (C.29) 

The  two  point  boundary  value  problem  is  considered  solved  when  h(zf ,  = 

0.  This  usually  involves  an  iterating  process  until  this  condition  is  satisfied. 
During  the  solution  process  6h  can  be  approximated  by 

6h  «  hk-  hk-i  =  r)hk-i  -  hk-i  =  -(1  -  rj)hk- 1  (C.30) 

ft*  —ahk~  1  (C.31) 

where  hk  is  the  value  of  h  at  iteration  k,  hk_i  is  the  corresponding  value  at 
iteration  k  —  1,  and  a  and  T]  are  positive  quantities  which  are  less  than  1.  The 
variation  of  h  is 

8h  =  hZf6zj  +  hUiSui  -f  htj8tj  (C.32) 

which  using  Eq.  (C.13)  evaluated  at  the  final  time  becomes 

8h  =  hZj§j8z0  +  (hZ} C/  +  hUt^j  8ui  +  (jiZfKj  +  ht j'j  8tf.  (C.33) 

At  the  initial  time,  since  x  is  known,  //Ui  =  0,  and  fit,  =  0,  8zo  is  merely 

’O' 

8X0 
0 
0 


8z0  = 


) 


(C.34) 
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hence 

$f8zo  —  $2j8^o-  (C.35) 

In  most  problems,  the  control  does  not  appear  in  the  end-point  function,  G; 
therefore, 

hUi  =  0.  (C.36) 

Using  Eqs.(C.35)  and  (C.36),  Eq.(C.33)  can  be  rewritten  in  matrix  form  as 


1  —  [  h zfCf  hZjKj  -f-  hi? 


8\0 
8ui 
8tf  j 


(C.37) 


where  a  is  chosen  to  ensure  that  \\h\\  decreases  after  each  iteration.  As  stated 
earlier,  h  is  of  dimension  i  +  k;  the  number  of  unknowns  is  i  +  k  and  are 
obtained  by  solving  Eq.  (C.37). 


C.3  The  Algorithm 

The  parameterized  shooting  algorithm  is  as  follows: 

1.  Guess  A0,  Ui ,  and  tj 

2.  Integrate  from  r  =  0  to  r  =  1 


’  Xo  ' 

/ 

-Hl(T,Z,Ui,tf) 

A0 

z  — 

-  «.•>*/) 

;  = 

0 

- Ht}(T,Z,Ui,tf ) 

0 

(C.38) 


$22  =  -Hx  A$22; 

$220  =  I 

(C.39) 

=  -0Tjr-*« 

w 

K> 

o 

II 

o 

(C.40) 

$42  =  ~Ht,  A$22! 

o 

II 

o 

IN 

(C.41) 

C'  =  F,(  +  FUi] 

& 

II 

o 

(C.42) 

K'  =  FZK  +  Ftj] 

£ 

II 

© 

(C.43) 

88 


3.  Evaluate  h  and  ||/i||.  If  ||/j||  <  e,  stop;  if  not,  go  to  Step  4. 

h(zf,Ui,tf)  =  1  X}  .  (C.44) 

ruif 

.  Vth  -  Gtf  _ 

4.  Calculate  hZf  and  ht}. 

5.  Compute  the  correction  terms  to  the  guesses  by  solving  the  linear  system 

r  a<>  l 

[  hzji&2f  hZf(f  hZfKj  -I-  hfj  j  6ui  =  oth/..  (C.45) 

Stf 

Choose  a  by  either  percent  correction  or  scaling  to  ensure  that  ||/i||jt+i  < 

11%. 

6.  Update  A0,  u,-,  f/;  go  to  Step  2. 


» 
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